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(57) Method and apparatus for image processing for comparing fingerprints and the like. To avoid 
reducing the accuracy of the comparison due to the variations of the fingerprint lines when the 
fingerprint input is made, a method has been resolved wherein the line width of the registered 
fingerprint is narrowed more than the line width of the tested fingerprint Reduction of the throughout 
of recording and comparison is solved by the selective utilization of the input of an activated fingerprint 
image, the judging of the fingerprint boundaries and the processing of only the activated division, and, 
additionally, in the comparison, by midway abandonment midway decision, multi-step variation of the 
increment, and/or introduction of a sub-template jump search. By introducing the degree of discord- 
ance between two images, it becomes possible to compare two images based on a comparison of the 
black pixels of the registered image to those of the image undergoing testing As a result, the processing 
amount for position matching is reduced in comparison with the case when all black pixels of two 
images are checked, or the entire images, including black and white pixels, are checked. Reduction of 
the amount of processing required for registration and comparison is resolved by setting the black pixel 
address of the narrowed image of the registered fingerprint to recorded information as a subtemplate 
and a non sub-template, by creating a storage form which takes into consideration the narrowed image 
by means of the storage of registered information, and by carrying out the reduction of registered data. 
Reduction of the throughput of narrowization processing (including thinning) was resolved by the 
direct detection of the center point of a black pixel aggregation, and by a preformed judging table. 
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BACKGROUND OF THE INVENTION 
Field of the Invention 

5 The present invention relates to an image processing device and a method thereof, wherein, when carrying 

out pattern recognition on a digitalized image (fingerprints, stamped images, diagrams, letter characters, etc.) 
through use of an image processing device (hardware/software in a computer, an electronic switching machine, 
a communication control unit, an IC card, an image recognition device, an image matching device, an image 
testing device, or the like), the image information for registration use is recorded in a memory device, this image 

10 processing device and the method thereof being further utilized to carry out a judgement as to whether or not 
two images are identical through a comparison of the concordance (concordant match) between the two im- 
ages. 

Prior Art 

15 

The case where the image is a fingerprint will be presented as an example of an image on which pattern 
recognition is to be conducted. A fingerprint is the pattern of the ridges of a finger. Furthermore, because through 
valley lines (the space between the ridges) are set by ridges, in place of using a pattern showing ridges, it is 
acceptable to use a pattern showing through valley lines as the fingerprint. The lines treated as a fingerprint 

20 shall be called "fingerprint lines". There are a variety of fingerprint input devices for confirming an individual's 
identity, such as the method of input from an image pick-up device {for example, a CCD (charge coupled device) 
camera), the prism method {for example, Shimizu et al., "Entry Method of Fingerprint Image with Prism - Com- 
parison between the Total Reflection Method and Light-Path Separation Method", IECE Journal, Vol. J68-D, 
No. 3, pp. 414-415 (1985)}, and the hologram method {for example, Igaki, et al., "Personal Identification Ter- 

25 minal using Holographic Fingerprint Sensor", Institute of Electronics Information and Communication Engineers 
of Japan (IEICE) Techenical Report, PRU 87-31 , pp. 27-33, (1 987)}. The fingerprint image of analog information 
input from an image pick-up device is converted into a gray scale image of a digitalized fingerprint by an ana- 
log/digital converter. This gray scale image of the fingerprint is indicated by coordinate (X,Y), which is the image 
memory pixel address, and by the brightness of the pixels, which is a component of each pixel address of image 

30 memory. The scheme of setting the X and Y axes is freely chosen. A fingerprint image may be formed by con- 
verting the concavities and convexities of the fingerprint directly into a binary image. Correction can then be 
carried out on the gray scale image of the fingerprint according to smoothing and using the direction of the ridg- 
es. End points, branch points and points of intersection are present as characteristic points which show the 
distinctive features of a fingerprint The characteristic points of the gray scale image of a digitalized fingerprint 

35 can be detected by binarizing a fingerprint image, further thinning it and then detecting whether a pattern iden- 
tical to the pattern of a region of pixels showing a characteristic point is present in the thinned image {for ex- 
ample, Sasagawa et al., "Personal Verification System with High Tolerance of Poor Quality Fingerprints", IEICE 
Journal, Vol. J72-D-II, No. 5, pp. 707-714 (1989)}. 

In a fingerprint comparison, the fingerprint for which information has been recorded in memory prior to the 

40 time of comparison is called the "registered fingerprint". The fingerprint which is compared for similarity to the 
registered fingerprint is called the "tested fingerprint". As methods for comparing a registered fingerprint to a 
tested fingerprint, a method utilizing the characteristic points of the fingerprint, a method of utilizing the direction 
of the ridges, and a method of matching the patterns of the original images of the tested fingerprint to that of 
the registered fingerprint are known. Japanese Patent Application, First Publication, Laid Open No. Sho 63- 

45 1 32386 discloses a comparison method relying on the superimposition of a thinned image of the tested finger- 
print and a thinned image of the registered fingerprint as a method of pattern matching of thinned images. 

Smoothing, a treatment for decreasing the noise of a fingerprint image, is, for example, recorded in "Hand- 
book of Image Analysis", pp. 538-548, Tokyo University Publishing (1991), Takagi and Shimoda (Eds.), in which 
there is a local summation averaging filter which uses the values of neighboring pixels of each pixel. 

so In the thinning process of a binary image, for those pixels which constitute a line, a majority (majority means 
from more than half to all, ideally all) of the line widths are set to a width of one pixel. Each pixel of each line 
may be either black or white. In the description which follows below, however, the case where each pixel of 
each line is black will be described. Hilditch's thinning method, in which the outer black pixels in a black pixel 
aggregation are sequentially deleted while the connectivity between black pixels is maintained, is available, 

55 among others, as a method of binarizing a gray scale image and carrying out thinning on that binary image. 
{For example, "Introduction to Computer Image Processing", Tamura (Ed.), Soken-Shuppan, pp. 80-83 (1 985); 
Tamura, "Research Related to Multi-sided Image Processing and Its Software", Electrotechincal Laboratory in 
Japan (ETL), Research Report, pp- 25-64, No. 835 (Feb., 1 984); and Mori, et al., "Fundamentals of Image Rec- 
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ognition [l] M , pp. 65*71, Ohm Corporation (1986)}. In Kobayashi, "A Thinning Method for Extracting Character- 
istic Points from an Image", IEICE (Institute of Electronics, Information and Communication Engineers of Japan) 
Technical Report PRU 90-1 49, pp. 33-38 (1 991 ), as well as a method of thinning a gray scale image or a binary 
image is disclosed. As for connectivity between black pixels, either 4-neighbor connected or 8-neighbor con- 
5 nected is used. 4-neighbor connected and 8-neighbor connected are also called 4-connected and 8-connected 
(e.g.. -Introduction to Computer Image Processing", Tamura (Ed.), Soken-Shuppan, pp. 70, (1985)). 

A method of creating a binary image by binarizing a light dark image is disclosed among others, for example, 
in Mori, et al., "Fundamentals of Image Recognition [I])", pp. 65-71, Ohm Corporation (1986). 

In the input of a fingerprint, because errors in recognition (rotation and/or parallel displacement) of the test- 
to ed fingerprint and the registered fingerprint occurs, it is necessary to carry out positioning of both fingerprints 
when performing a comparison between a tested fingerprint and a registered fingerprint. As a method of position 
matching (rotation, vertical and horizontal displacements), a method utilizing the ridge direction, a method ac- 
cording to representative characteristic points and neighboring characteristic points, and a method of trial and 
error of displacing in parallel only the moveable area are known as methods to position set the image so that 
15 the greatest degree of concordance is achieved. A conventional method for performing the coordinate trans- 
formation and the geometric transformation necessary when carrying out position matching is disclosed in, for 
example, Plastock, et al., translated by Koriyama, Theory and Problems of Computer Graphics*, pp. 84-88, 
McGraw Hfll Inc. (1987). 

In the position matching during an image comparison, it is useful to obtain the approximate center point of 

20 the fingerprint image. Japanese Patent Application, Second Publication, Laid Open No- Sho 58-55548 "A Meth- 
od for Determining the Center Position of a Figure" discloses a method in which the ridges having gradients of 
sudden increase are investigated one by one, obtaining the center point. In Ito, et al., "An Algorithm for Clas- 
sification of Fingerprints Based on the Core", IEICE Technical Report, PRU 89-79, pp. 15-22 (1989) a method 
is disclosed of utilizing the parallel lines of each rectangular area and the number of intersections to approach 

25 one by one the center points. In "An Extraction Technique of the Pivot Location for Automated Fingerprint Iden- 
tification Process", IEICE National Conference on Information and Systems, No. 125, (1987), the number of 
ridges passing through each scanning line is calculated and the distribution of the number of lines is obtained. 

In Kobayashi, "A Template Matching Scheme for Fingerprint Image Recognition", IEICE Technical Report, 
PRU 91-45, and in the IEICE Journal, pp. 25-30 (July, 1991), a method according to the template matching of 

30 the black pixels obtained from the thinned line image of a registered fingerprint (or an image on which narrow- 
ization has been performed) to the binary image (or an image on which narrowization has been performed). In 
this method, the quantity of processing and the quantity of memory are decreased more than in a method car- 
rying out template matching utilizing binary images. Narrowization means to reduce the line width of an image. 
Thinning means to reduce the line width of an image to 1 pixel. Thinning is a special case of narrowization. 

35 In the memory conservation of registered information, it is necessary to make the quantity of memory as 

small as possible. In the present invention, it is necessary to memory store as registered information a binary 
image which has undergone narrowization processing. As a method of memory storing line figures, Freeman's 
method according to chain symbols {i.e., Yasuiin and IMakajima, "Image Information Processing", pp. 113-114, 
Morikita Publishing (1991)} is known. However, the application of this method to a case where the image is a 

40 complicated one, as in the case of a fingerprint image, is difficult. 

SUMMARY OF THE INVENTION 

It is accordingly a general object of the present invention to reduce the throughput of the recording and the 
45 comparison of a fingerprint image. An improvement in the accuracy of the comparison, a reduction in the quan- 
tity of registered information, etc. have also been taken into account. Previously, in a fingerprint comparison, 
a large proportion of processing was occupied with the recovery of the fingerprint lines, thinning and with the 
position matching of the comparison. 

In a method whereby the characteristic points of an image (end points, branch points and points of inter- 
so section) are compared, the quantity of processing required forfingerprintline recovery is large, and, in the event 
that the characteristic points are not clearly defined or are not many in number, carrying out a comparison be- 
comes difficult. In a comparison method by pattern matching the original images of a registered fingerprint and 
a tested fingerprint, incorrect discrimination can easily occur due to an alteration of the width of the ridges of 
the fingerprint because of finger pressure, the condition of the dryness of the skin of the finger and the like, at 
55 the time when the fingerprint impression is made. Further, the memory quantity required for storage of regis- 
tered information becomes large. 

(1 ) To avoid reducing the accuracy of the comparison to the variations of the fingerprint lines when the fin- 
gerprint impression is made, a method has been resolved wherein the line width of the registered fingerprint 
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is narrowed more than the tine width of the tested fingerprint. 

(2) Reduction of the throughput of the recovery of the fingerprint lines is solved by a comparison means 
which does not utilize characteristic points. 

(3) Reduction of the throughput of recording and comparison is solved by the selective utilization of the 
5 input of an activated fingerprint image, the judging of the fingerprint boundaries and the processing of only 

the activated division, and, additionally, in the comparison, by midway abandonment, midway decision, 
multi-step variation of the increment, introduction of a sub-template jump search, and/or mismatch ratio. 

(4) Reduction of the amount of processing required for registration and comparison is resolved by setting 
the black pixel address of the narrowed image of the registered fingerprint to recorded information as a 

10 sub-template and a non sub-template, by creating a storage form which takes into consideration the nar- 
rowed image by means of the storage of registered information, and by carrying out the reduction of reg- 
istered data. 

(5) Narrowization processing (including thinning) was resolved by the direct detection of the center point 
of a black pixel aggregation, and by a preformed criteria table. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.1 is a schematic diagram of a fingerprint recognition system related to the first embodiment of the pres- 
ent invention; 

20 FIG.2 is an explanatory drawing of the method of utilization of image memory and memory; 
FIG.3 shows examples of pixel aggregations; 

FIG.4 shows examples of sub- template/no n sub-template classification for a fingerprint area; 
FIG. 5 is an example of a table showing the activated sub-divisions of a fingerprint; 
FIG. 6 is a simple example of image correction; 
25 FIG.7 is an example of an explanatory drawing of the procedure for obtaining the approximate center point 

of a fingerprint image; 

FIG.8 is an abbreviation of the partial process of thinning a binary image (i.e., procedure A) 
FIG.9 is an abbreviation of the partial process of the thinning of unresolved pixels (i.e., procedure T); 
FIG.1 0 is an example showing the abbreviation of the thinning for unresolved pixels, FIG. 10(a) is an un- 
30 resolved pixel aggregation and the surrounding black pixel line, FIG. 10(b) shows the thinned image after 

thinning has been accomplished for the unresolved pixels of FIG.1 0(a); 

FIG.1 1 is an abbreviation of the process for thinning decision data for unresolved pixels (procedure H); 
FIG.12 is an example of the table for storing the thinning decision data for unresolved pixels; 
FIG.1 3 is an example of the division of a registered image into 3x3 pixel aggregations; 
35 FIG. 14 is an abbreviated flow chart of comparison processing; 

FIG.1 5 is an explanatory drawing for computing the degree of discordance; 

FIG.1 6 is an abbreviated flow chart of the auxiliary image concordance check procedure for the check of 
image concordance (i.e., procedure W); 

FIG.1 7 is an example of an abbreviated flow chart of fingerprint input processing, registration processing 
40 and comparison processing; 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

As an example of the preferred embodiment of the present invention, the case where the image is a fin- 
45 gerprint (sometimes called a fingerprint image) will be described below. FIG. 1 is an example of a fingerprint 
recognition system. A fingerprint which has been input from image input device 2, is processed at image proc- 
essing device 1 . Image processing device 1 is provided with an image memory 4 for storing, when necessary, 
the gray scale image of a fingerprint the binary image and the image on which a variety of processing steps 
have been performed. Image processing device 1 is further provided with central processing device 5 having 
so one or more central processing units (CPU), and a memory 6 for storing such information as programs, data, 
and files (data collection). In the case where memory devices having differing characteristics (for example, half 
conductor memory and magnetic disc) are included in memory 6, the transport of information between the mu- 
tual space of these can be carried out by means of hardware or software as necessity demands. Image memory 
4 and memory 6 are classifications according to the stored information and can be realized through utilization 
55 of the same memory device. Image input device 2 is provided with image pick-up device 7. A/D converter 3 
converts analog information into digital information (here, in the case where using an image input device of the 
type in which the digital image is directly obtained, an A/D converter is not necessary). Each pixel address in 
image memory 4, where the fingerprint image which is the gray scale image of a digitalized fingerprint is stored, 
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is shown by the X and Y coordinates (X, Y). Pixel address (X,Y) is sometimes indicated as "pixel (X, Y)*, or simply 
"(X,Y)". The section of image memory 4 which stores a single image is called the image plane. Image memory 
4 can hold one or more image planes. 

Each image plane of image memory 4 is constituted of pixels. When the domains of all of the pixel address- 

5 es are set to 0 £ X ^ Xh, 0 ^ Y ^ Yh, the processing domain which is specified within the domain of this pixel 
address is processed. In the case where a number with a decimal is generated for the pixel addresses or the 
number of pixels because of calculations which include the number of pixels and the pixel addresses, proc- 
essing is earned out by either rounding these numbers up or down. The value of the pixel value is shown by 
the degree of brightness. Which section of the brightness becomes a ridge depends upon the processing of 

10 the image in image processing device 1 , and upon the method of processing of image input device 2. tn both 
cases, processing is possible by presetting in image processing device 1 the brightness characteristics corre- 
sponding to the ridges. The aggregation of one or more pixels is called a "pixel aggregation**. In fingerprint rec- 
ognition, the fingerprint which is input from image input device 2 for entry in memory 6 of image processing 
device 1 is called the "registered fingerprint 11 , and the fingerprint which is input from image input device 2 for 

15 testing is called the "tested fingerprint". In an image which is binarized into black and white pixels, either the 
black pixels or the white pixels may be selected as the preferred pixel to comprise the lines of the fingerprint 
(either of these may be made to correspond to ridges or valley lines). 

In the preferred embodiments of the present invention, black pixels will be treated as the fingerprint lines. 
Thinning is the process through which a majority of the line widths are set to the width of one pixel. However, 

20 in the preferred embodiments of the present invention, the narrowing of some or all of the line widths of a black 
pixel aggregation so that they are included in an image formed by the black pixels of the original binary image 
will be called "narrowization processing". Accordingly, in the preferred embodiments of the present invention, 
thinning is one type of narrowization processing. Additionally, line width is defined as the shortest distance 
(number of pixels) required to travel from an optional point set at one edge of a line to a point at the other edge 

25 of the same line, this distance being traveled by crossing through the inner portion of the line. Line width can 
be set for each position of the edge of a line. 

FIG. 2(a) shows the condition of the image data which is stored in image memory 4. The digitalized image 
(binarized image or gray scale image) obtained from the image which was input from image input device 2 is 
stored in the image plane of image 10. In the image plane of image 11, past images, for example, are stored 

30 and can be utilized in the processing of image 10. Depending on the selection of the processing steps, image 
11 may be unnecessary. In this case, memory 4 may utilize only image 10. FIG. 2(b) shows the state of the 
information stored in memory 6. Program and data for realization of the preferred embodiments of the present 
invention are stored in program and data 12, while, in registered information 13, recorded information for the 
registered fingerprint image is stored in a file and maintained. 

35 In the case where the image is a gray scale image, a symbol value corresponding to the degree of bright- 

ness is fixed. Depending on the method of image input, a gray scale image established by image memory 4 
may be binarized and obtained, or a binarized image may be directly established by image memory 4. A bina- 
rized image is shown by means of black and white pixels only. The symbols corresponding to the respective 
degree of brightness values of the black and white pixels (for example, black pixel=1 and white pixel=0) are 

40 set Whether the black pixels are assigned to sections having a high degree of brightness or to sections having 
a low degree of brightness is determined by the image desired, and by the method of input of that image. Cor- 
respondence to either case is possible. The coordinate axis and the logical origin point of the image stored in 
image memory 4 may be fixed independently as a position of a pixel of physical memory image 4. While the X 
axis and the Y axis may be freely set, for the convenience of explanation, the direction of the X axis is from left 

45 to right in the horizontal direction (i.e., in the direction of the increasing value of X), and that of the Y axis is 
from up to down in the vertical direction (i.e., in the direction of the increasing value of Y). 

An aggregation of pixels will be called a "pixel aggregation". FIG. 3(a) is an example of a pixel aggregation 
in which the pixels are arranged in a 3 x 3 matrix (i.e., 3 pixels x 3 pixels). FIG. 3(b) is an example of a pixel 
aggregation in which the pixels are arranged in a 4 x 4 matrix. FIG. 3(c) is an example of a pixel aggregation 

so in which the pixels are arranged in a 4 x 3 matrix. 

Notations and definitions are shown as follows. Some of these notations, however, will not appear in the 
following explanation. 

[m]: Indicates the rounding down below the decimal point of an optional number m 

I | : Indicates concatenation of two values. For example, 2 I I 3 | I 4 = 234 

55 f(X,Y): Degree of brightness in pixel address (X,Y) 

FA: Fingerprint Area; because the fingerprint area can be expressed by using only the fingerprint 

boundaries, the fingerprint area is stored in memory 6 as fingerprint boundary information. 
The fingerprint boundary will be treated as the internal area of the fingerprint 
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(Xc. Y c ): The address of the approximate center of the fingerprint 

(X RC , Y RC ); The address of the approximate center of the registered fingerprint 

(Xtc» y tc): The address of the approximate center of the tested fingerprint 

Rth: The modified image of a registered fingerprint (i.e., the first modified image) which was ob- 

tained by carrying out at least narrowization processing on the binary image of the registered 
fingerprint (primary image) obtained from the original image of the registered fingerprint (gray 
scale image or binary image) 

Tth; The modified image of a tested fingerprint (i.e., second modified image) which was obtained 

by carrying out at least narrowization processing on the binary image of the registered fin- 
gerprint obtained from the original image of the tested fingerprint (gray scale image or binary 
image) 

RA: The aggregation of all of addresses (X,Y) of the black pixels within the fingerprint area which 

is in modified image Rth of the registered fingerprint; RA is the sum-set of RT(0), RB(0) and 
the area of the fingerprint not utilized. 

RT(0): RT(0) is a sub-set of RA; RT(0) designates the area of the pixel aggregation in which one or 

more optional numbers are segregated as the smallest area of RA; RT(0) will be called the 
"sub-template"; The portion of the image which samples the sub-template is sometimes called 
the "sub-template portion". The sub- template is used for position matching of the image, (re- 
fer to FIG! 3) 

RB(0): The aggregation of the portion of the black pixel address which excludes RT(0) from RA. 

RB(0) is a subclass of RA and designates the area of the pixel aggregation which has seg- 
regated one or more optional numbers. RB(0) will be called the N non sub-template". The por- 
tion of the image which samples the non sub template is sometimes called the non sub- 
template portion. The non sub-template is not used for position matching of the image. (refer 
to FIG. 3) 

RT(S): The aggregation of black pixel addresses (X, Y) of the sub-template RT when the coordinate 

axis of the modified image of the registered fingerprint is rotated S degree about a point which 
is optionally set as center 

RT(S, H, V): The aggregation of the addresses of subtemplate RT(0) in the coordinate axes following the 
rotation S° of the coordinate axes of the modified image of a registered fingerprint about an 
optional point (i.e., the approximate center point of the registered fingerprint), and after car- 
rying out horizontal displacement H, and vertical displacement V; RT(0,0,0) = RT(0) and 
RT(S t 0,0) = RT(S); (A single pattern which is translated through coordinate conversion of the 
modified image of a registered fingerprint is set according to the value of the set S, H, and V, 
which designates the position of translation) 

RB(S, H, V): The aggregation of the addresses of non sub-template RB(0) in the coordinate axes following 
the rotation of the coordinate axes of the modified image of the registered fingerprint image 
S(0) about an optional center point (for example, the approximate center point of the regis- 
tered fingerprint), and after carrying out horizontal displacement H ( and vertical displacement 
V; RB(0,0,0)=RB<0) and RB(S,0.0)=RB (S) 

N1m: The number of the concordant black pixels of the sub- template; indicates the number of black 

pixels which are concordant between the sub-template of the registered fingerprint and the 
sub-template of the tested fingerprint 

N1c: The total number of black pixels in the sub-template; indicates the total number of black pixels 

in the sub- template of the registered fingerprint 

N2m: The number of concordant black pixels in the non sub- templates; indicates the number of 

black pixels which are concordant between the non sub-template of the registered fingerprint 
and the non sub-template of the tested fingerprint 

N2c: The total number of black pixels of the non sub- template; indicates the total number of black 

pixels in the non sub-template of the registered fingerprint 

Nm: Indicates N1m or N2m; Counter Nm is the value of the counter for calculating Nm (the case 

where Nm = N1 m + N2m also exists). 

Nc: Indicates N1 c or N2c; Counter Nc is the value of the counter for calculating Nc (the case where 

Nc = N1c + N2c also exists). 
FIG. 4 shows an example of the relationship of the fingerprint area determined by fingerprint boundaries, 

to the portion which samples sub-template RT(0), and to the portion which samples non sub-template RB(0), 

in image 10 in image memory 4. Examples 1-4 are examples of the sub-template portion and the non sub-tem- 
plate portion. 
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The means for carrying out the processing of a fingerprint image wilt be described below. Additionally, in 
the steps of the procedures of each means, when the subsequent processing is not recorded, the step imme- 
diately following is proceeded to. Taking into consideration the variety of conditions of image processing device 
1 and image input device 2, the predetermined number utilized in each means is set statically or dynamically 
5 to an appropriate value. The realization of each step may be varied provided that the contents of processing 
are identical. 

I. Smoothing Processing Means 

10 Smoothing is the process of decreasing the noise of a fingerprint image. Smoothing processing can be car- 
ried out through utilization of a conventional method. (For example, a local summation averaging filter or the 
like, which utilizes the value of the neighboring pixel of each pixel, may be used). 

In the case where a binary image can be input directly to image memory 4, smoothing can be omitted. When 
a binary image is smoothed, because the image becomes a gray scale image, it is necessary to carry out bi- 
ts narization once again. 

II. Binarization and Background Segregation Means 

Binazation is the process of changing a gray scale image into a binary image. Background segregation is 
20 the process of clarification of the activated area of the fingerprint image of image 10 in image memory 4. An 
example of a procedure for carrying out binarization and background segregation is given in procedure B below. 
The input information of procedure B is the input information of the image. The output information of procedure 
B is the binary image of the output image and the boundary information of the fingerprint. When an image input 
device of a type which can directly input a binary image to image memory 4 is utilized, binazation is omitted 
25 (step B1), and only background segregation is carried out. In the event that background segregation by binar- 
ization is unnecessary, execution of step B1 only is permissible. 
(Procedure B) 

K is defined as a predetermined number indicating the length in the direction of X of the sub-division (equal to 
the length in the direction of Y of the sub-division area). And, 
30 L = (Xh + 1)/K 

Here, K is selected so that L is an integer (in general, it is possible to vary the length of each sub-division). 
And, 

Kmax = ((X h + 1)/K)-1 

For image 10, the sub-division addresses for uniquely and clearly discriminating between sub-divisions are de- 
35 fined as an initial pixel address for each sub-division. Optional pixel address (X,Y), at sub-division address 
J(M,N), is M =p(/K], and N =[Y/K]. Accordingly, pixel address (X,Y) corresponding to sub-division address 
J(M,N) is obtained by, 

X = K -M,(M = 0, 1, 2, ...K^) 
Y = K • N, (N = 0, 1, 2 

40 

Step B1 (binarization): 
For 

M = 0,1,2 

45 N = 0,1.2 

the following processing is carried out The average brightness Bav(M.N) of all of the pixels within each sub- 
division is obtained for each sub-division J(M,N) from 

Bav(M.N) = (the sum of the brightness of the pixels within the sub-division)/(the number of pixels within the 

sub-division) 

so Next, (M,N) in 

X=K-M(M = 0- ^ 
Y = K ■ N (N = 0-K^J 
is made the limit of image 10. In other words, when the limits of the image are 

0 ^ X ^ X h 

55 0 ^ Y ^ Y h 

the limits become 

M = 0 - [Xh/K] 
N = 0 - [Y^K] 

7 
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and, 

total number of sub-divisions in image 10 = ([Xh/K] + 1)([Yh/K] + 1) 
For each sub-division, for the degree of brightness f(X,Y) of pixel (X,Y) of the sub-division for which 
Bav(X,Y) was obtained, the threshold value T of the binarization is set to 
5 T= average value of brightness of sub-division + D 

{where D is a constant (positive, negative or zero) predetermined number} 

When f{X,Y) £ T, (X ( Y) for this sub-division (M,N), i.e., the (X,Y) of the region of 

KM^X^K(M+1)-1 
K • N = Y ^ K • (N + 1)-1 

10 is set to white pixels (however, when reversing the pixels, (X,Y) is set to black pixels), while when f(X,Y)<T, 
the (X.Y) is set to black pixels (however, when reversing the pixels, (X,Y) is set to white pixels). 

At this point, B L and B H are set as the constants for classifying activated and non activated sub-divisions. 

Step B2 (rendering a judgement of "activated" to a sub division) 

15 

The average value of the degree of brightness of the sub-division is again obtained for the binary image 
resulting from step B1. Next, for 

sub-division address I M n = (X/K],[Y/K]) 
(The sub-division address is the initial address of each sub-division) 
20 X = K ■ M, (M = 0, 1,2, ...K max ) 

Y = KN,(N = 0, 1, 2, .JW) 
a judgement of "activated/non-activated" is rendered for each sub-division according to the average value of 
the degree of brightness Bay(X.Y) obtained from the function of the average value of the degree of brightness 
for each sub-division. In other words, in a sub-division where B L ^ Bav(X,Y) ^ B H , that sub-division is judged 
25 to be an activated sub-division and is so set to the activated sub-division table G(M,N). 

( 

| l : activated sub-division 

30 I 
G (M,N) « I 

| 0 : non-activated sub-division 

I 

35 

The non-activated sub-division of image 10 is set to white pixels. 

Step B3 (Inspection of the number of activated sub-divisions) From G(M,N), 



40 YT = number of activated sub-divisions 

is counted. When YT ^ YC (YC is a constant number), step B4 is proceeded to. When YT < YC, due to a short- 
age error in the number of activated sub-divisions, the present procedure undergoes an error return. 

Step B4 (left margin of the fingerprint boundary of a sub-division unit); 

45 

The information of the fingerprint boundaries of a su-bdivision is shown by {(N T( M L , M R ), Nj= 0 - Kmax}. 
For each N = N T value, Ml ^ M = Mr is the fingerprint area of the sub-division unit. 

The left margin of the fingerprint boundary is obtained for the sub-division unit. Starting from N=0,the fol- 
lowing process is carried out for N=N T , (Nr= 0 - K^). Beginning from the left margin (M=0) and continuing in 

so the increasing direction of M, those elements G(M,N) having an indicator of "1" (indicating an activated sub- 
division) in table G, which shows the activated sub-divisions, are searched for sequentially. The value M L of 
the initial M of a section in which indicators having a "I" value are continuous for Kc (Kc is a predetermined 
number greater than 1 and used for judging the fingerprint boundaries of the sub-division) indicators or more 
is set as the left margin of the fingerprint area for the current N. At M = 0 - Kmax, when indicators having a 

55 value of °1 " (indicating an activated sub-division) are not found to be continuous for K c indicators or more, the 
value of the current N is the non fingerprint area for all M and, at N T of the non fingerprint area, 

M L = Mr = -1 

8 



BNSDOCID: <EP 0508845A2.I, > 



EP 0 508 845 A2 

Step B5 (right margin of the fingerprint boundary for each sub-division): 

Here, the right margin M R of the fingerprint boundary is obtained for each sub-division unit Starting from 
N = 0, for N = N T (N T = 0 ~ Kma*), any N for which the left margin was not set in step B4 (i.e., the N when M L 

5 = -1) is skipped. Beginning from the left margin (M=Kmax) and continuing in the decreasing direction of M, those 
elements G(M,N) which are indicated by "1" (indicating an activated sub-division), are searched for sequentially. 
The value M R of the initial M of a section in which indicators having a value of "1" are continuous for Kc (K c is 
a predetermined number) or more indicators is set as the left margin of the fingerprint area for the current N. 
From the preceding, information {(N T , M L , Mr), N t = 0 - K max } on the fingerprint boundaries of the sub-division 

10 is obtained. 

Step B6 (fingerprint boundary information of each pixel) 

The fingerprint boundary information of each pixel is obtained from the fingerprint boundary information 
75 {(N T , Ml, Mr), N t = 0 - Kmax} for each sub-division. The fingerprint boundary information of each pixel is shown 
by {(Y T , X L , Xr), Y t = 0 ~ (Y h - 1)}. For the value of each Yj, Xj_ = X = Xr is the fingerprint area. 

According to the fingerprint boundary information of the sub-division, in N = 0 - K^, for Y = Y T of K x N 
^ Y ^ K x N + Kmax, 

Xl = K - M L 

20 Xr = K ■ Mr + Kmax 

The fingerprint boundary information {(Y T) Xl, Xr), YT = 0 ~ (Y h - 1)} of each pixel is obtained. 
(End of procedure B) 

From this point on, for the sake of simplicity, the term "fingerprint boundary information" will indicate the 
fingerprint boundary information {(Y T , X L , Xr), YT = 0 - (Y h - 1)} of each pixel. 
25 FIG. 5 is an example of a table showing the activated area of a fingerprint 

III. Process for Timing Confirming Input from Image Input Device to Image Memory 

In order to vary image 10, which was input from image input device 2 to image memory 4, by translating 
30 the object in image pick-up 7, it is necessary to set the timing which confirms image 10 of image memory 4 to 
obtain a good quality image. For this purpose, the processing includes, 

(1) a process for notification of the confirmation timing of the image by a signal from image input device 2 
to image testing device 1, 

(2) a process in which the user indicates the confirmation timing of the image to image testing device 1, 
35 or 

(3) a process in which image testing device 1 checks and sets the confirmation timing of the image and 
the condition of image 1 0 of image memory 4. 

A preferred embodiment of process (3) follows below. 

The image input timing is judged according to the activated block rate of a small region of image memory 
40 4. The activated block rate can be obtained in the same manner as steps B1 ~~B3 of procedure B. This procedure 
is shown in procedure Bs. 

In procedure Bs, when the ratio of the activated sub-division is below the threshold value, procedure Bs 
is retested after a set time has elapsed. The input information of procedure Bs is the input image information 
and the limits of the small window area of image memory 4. The small window area is the limits included in the 
45 limits of image 1 0 which is used in procedure B. Additionally, in order to reduce processing time the processing 
limits are made smaller than in procedure B. If the processing time is not a consideration, image 10, which is 
used in procedure B, may be made the object The output information of procedure B is the confirmation or 
non-confirmation of image 10. 
(Procedure Bs) 

50 K is set to a constant showing the length of the subdivision in the X direction (equal to the length of the 
subdivision in the Y direction), and 

L - (X h + 1)/K 

K is selected here so that L is an integer (in general, the length of the sub-division can be varied for each sub- 
division), and 

55 ^ = ( «, + 1) "<} - 1 

For image 10, the sub-division addresses for clearly distinguishing sub-divisions are set to the initial pixel ad- 
dress of each sub-division. Optional pixel address (X.Y), at sub-division address J(M,N), is M = [X/K], and Nl 
= [Y/K]. Accordingly, pixel address (X,Y) corresponding to sub-division address J(M,N) is obtained according 

9 
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to, 

X = K M, (M = 0,1, i-K^ 
Y = K • N, (N = 0,1. 2,...K mi)( ) 

5 Step Bs1 (binarization) 
For 

M = 0,1,2,...K BM 
N = 0.1.2....K.., 

ro the following processing is carried out The average brightness value Bav(M,N) of all pixels within each sub- 
division is obtained according to 

Bav(M.N) = (sum of brightness of the pixels within sub- division)/ 
(number of pixels within sub-division 
for each sub-division J(M,N). Next, for {M,N) in 
15 X = K • M, (M = 0 ~ K^) 

Y = K • N, (N = 0 — K max ) 
only the complete small window is processed in the following steps. In other words, when the small window is 

Xs^X^X s + X L - 1 
Y s ^Y^Ys + Y L -1 

20 the limits are 

M = [Xs/K]-[(X S + X L -1)/K] 
N = [Ys/K]-[(Y S + Y L -1)/K] 
total number of sub-divisions within small window = (|{X S + X L -1)/K]- [Xs/K] + 1) x 
(KYs + Y L -1)/K]-[YsA<] +1) 
25 For each sub-division, the threshold value T for brightness f(X,Y) of pixel (X,Y) of a sub-division for which 

Bav(X,Y) was obtained is, 

T = average brightness value of sub-division + D 
(D is a constant integer, positive, negative or zero) For (X,Y) of sub-division (M.lSl) at this time, i.e., (X,Y) 
in the limits of 

30 KM^X^K(M + 1)-1 

K N ^ Y ^ K • (N + 1)-1 

when f(X,Y) ^ T, (X,Y) is set to white pixels (or black pixels when an indication of a white-black reversal is pres- 
ent). 

When f(X,Y) < T, (X,Y) is set to black pixels (or white pixels when an indication of a white-black reversal is 
35 present). 

Here, B L and B H are constants for classifying activated and non-activated sub-divisions. 

Step Bs2 (activated sub-division judgement): 

40 The average brightness value of the sub-division is again obtained for the binary image resulting from step 

Bs2. Next, for the internal area of the small window within 

sub-division address l MN = ([X/K], [Y/K]) 
(the sub-division address is the initial address of each sub-division) 

X = K - M, (M = 0, 1.2....K,™) 

45 Y = K • N, (N = 0. 1.2, ...K^) 

a judgement of "activated/non-activated" is rendered for each sub-division according to the average brightness 
value Bav(X.Y) obtained from the f(x) of the average brightness of each sub-division. In other words, when 

B u ^B av (X f Y)^BH 

that sub-division is judged to be "activated" and an indication to this effect is set in activated sub-division table 
50 G(M,N). 



55 
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r 

I 1 : activated sub-divison 
G <M,N) - I 

I 0 : non-activated sub-divison 

I 



10 The non-activated sub-divisions within the window are set to white pixels. 

Step Bs3 (inspection of the number of activated pixels) 

YT = number of activated sub-divisions within the small window 
15 is counted according to G(M,N), and when 

YT S YCB (YCB is a constant) 
the process ends with image input confirmation being possible. When 

YT< YCB 

the process ends with image input confirmation not being possible. 
20 (End of procedure Bs) 

IV. Image Correction Processing 

The degree to which it is necessary to carry out image correction is determined by the quality of the image. 

25 As necessary, omissions or reinforcements are carried out. For example, it is possible to perform such simple 
corrections to image 10 as the exclusion of aggregations of isolated black pixels (by changing them to white 
pixels), filling aggregations of isolated white pixels (by changing them to black pixels), etc. according to the 
neighboring pixel pattern for each pixel within the fingerprint area of the binary image. 

image correction in the preferred embodiments of the present invention is supplied with the objective of 

30 providing an ability to sufficiently carry out narrowization. An example is shown in procedure T of the procedure 
for carrying out such simple corrections to image 10 as the exclusion of aggregations of isolated black pixels 
(by changing them to white pixels), the filling in of aggregations of isolated white pixels (by changing them to 
black pixels), etc., according to the neighboring pixel pattern for each pixel within the fingerprint area of the 
binary image. The situation shown applies to the individual processes carried out on a 5 x 5 pixel aggregation. 

35 In general, the identical processing can be performed for a pixel aggregation of n x n (n = 2k + 1 , k = 1, 2,...). 
It is necessary to appropriately set the size of the pixel aggregation on which image correction is being carried 
out in response to the pixel number of image memory, the quality of the image, etc. An example of the trans- 
formation of black and white pixels after the positions of individual appellations P0-P24 of a 5 x 5 pixel aggre- 
gation centered about an optional pixel P 0 and procedure TZ have been applied is shown in FIG. 6(a) and FIG 

40 6(b). The input information of procedure TZ is the input image information and the information of the fingerprint 
boundary. Output information is the output image information. 
(Procedure TZ) 

A pixel focused on in the inner region of the fingerprint (including boundaries) in image 10 is set to Po = 
(X,Y). The processes of steps T1 ~ T4 are repeated for 
45 X = 5u + 3,(u = 0. 1, ,..[(X h -3)/5]) 

Y = 5v + 3, (v = 0, 1 , ...[(Y h -3)/5]) 
(i.e., here, (X,Y) is selected every 6th pixel) 

Additionally, because the region outside the fingerprint area has been set to white pixels during binarization, 
the pixels of a 5 x 5 pixel aggregation are all either black or white. When processing 5x5 pixel aggregations 
so following selection of P 0 within the fingerprint area, it is not necessary to consider the fingerprint area. 

Step TZ 1 (P 0 selection) 

Whether or not pixel P 0 = (Xo,Y 0 ) is within the fingerprint boundary is checked according to fingerprint 
55 boundary information (Y T , X L , X R ). In other words, for X L and X R of Y T , which becomes Y 0 = Y T , when X L ^ Xq 
^ Xr, then P 0 is within the boundary of the fingerprint. If X L ^ Xo ^ X R is not satisfied, then P 0 is outside the 
boundary of the fingerprint Next, 

(1) when P 0 is within the boundary of the fingerprint, step TZ2 is proceeded to 

11 
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(2) when P 0 is outside the boundary of the fingerprint, the next P 0 is proceeded to and processing is carried 
out from step T71 

Step TZ 2 (removal of an isolated black pixel aggregation): 

5 

The removal of aggregations of isolated black pixels is performed in this step. 

(1) When P9 — P24 are all white pixels, the pixels of P<> ~~ Pa are all set to white and step "TZ3 is proceeded 
to. When this is not the case, (2) is proceeded to. 

(2) When Pi - P 6 are all white pixels, P 0 is set to a white pixel and step T23 is proceeded to. If this is not 
10 the case, step TZ3 is proceeded to without anything being done. 

Step TZ 3 (removal of an isolated white pixel aggregation): 

In this step the process of filling in an isolated white pixel aggregations (which can be thought of as "holes") 
15 is performed. 

(1) When 

P9 ~~ P24 sre 3" black pixels, the pixels of Po - Ps sre set to all black pixels and step TZ4 is pro- 
ceeded to. If this is not the case, (2) is proceeded to. 

(2) When - P 8 are all black pixels, P 0 is set to black pixels and step TZ4 is proceeded to. If this is not 
the case, step TZ4 is proceeded to without anything being done. 

20 

Step TZ 4 

Terminates this procedure 
(End of procedure TZ) 

25 In procedure TZ, at steps TZ2 and TZ3, when the pixel which is to be updated already is of the value it is 

to be updated to, updating is not necessary. However, update may be carried out in order to avoid value con- 
firmation processing. 

V. Process for Obtaining Approximate Center Point 

30 

Additionally, there is a process for regarding the center of image 10 ([X h /2],[Yt/2]) or a nearby point to be 
the approximate center point (Xc,Y c ) located at the approximate center point of the image. 

As a separate step, from the binary image of the fingerprint in image 10, a procedure in order to find the 
approximate center point of the area of the fingerprint is shown below in procedure Q. The input information of 
35 procedure Q is the input image information and information of the fingerprint boundary. The output information 
of procedure QZ is the approximate center point (Xc,Y c ). Each constant, fingerprint area and function of the 
approximate center point are shown in FIG. 7. 
(procedure QZ) 

40 Step QZ 1 (process for obtaining Y c ) : 

For the limits of 

V L =iX*V R 

parallel line Y = KAj (i=1 ,2 n; H D ^ Y ^ Hu) and line KH t (i=1 ,2,...n), which intersects with the black pixel line 

45 forming the fingerprint line, are obtained. Here, the line segment width of each intersecting section of black pix- 
els is set at or above a fixed value (for example, one pixel). For H D , Hu. V L . V R , the limits V t ^ X ^ V R and H D 
^ Y ^ Hy are within the fingerprint area and are constant numbers selected so that they become the settable 

limits of the approximate center point. KAj (i=1 ,2 n) is a constant which sets the scanning position. 

Next, for line KH ( (i=1,2,...n) intersecting parallel line Y=KA t , i=i m , for which KHi (i=1,2,...n) is large, is ob- 
50 tained. In general, there is one or more i m (set to T y ). Y c , which is the Y coordinate of the approximate center 
point, is obtained according to 

Yc = (2 ( = i m KA,)/r y 
Here, It= im KA| indicates the sum of KAj for each i=im. 

55 Step QZ 2 (process for obtaining X c ) : 

For the limits of H D £ Y ^ H U( 

vertical line X=KB| (i=1,2,...n; V L ^ X % V R ) and the number of lines KV, (i=1,2,...n) intersecting with the 

12 
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black pixel line which is the fingerprint line, is obtained. Here, the line segment width of intersecting sections 
of black pixels is set to a fixed value (for example, one pixel). KB| (i=1,2,...,n) is a constant number. 

Next, for the number of lines KV t (i=1,2 n) intersecting with vertical line X=KB t , i=i m is obtained in which 

KV| (i=1,2,...n) is large. In general, there is one or more is (set to T x ). X^ which is the X coordinate of the ap- 
5 proximate center point, is obtained according to 

Xe = ft.bKB^, 

Here, £j= lfn KB ( indicates the sum of KBj for each i=is. 
Step QZ 3 

10 

(Xc,Yc is set as the approximate center of the fingerprint area. 
(End of procedure QZ) 

Restrictions are set to the limits for which an approximate center point is obtained for a fingerprint with an 
unclear center point. The procedure is as follows. The limits of the approximate center point can be set to an 
is optional shape and are set to small limits which can be dealt with by comparison processing. For example, 
XcL^X^XcH.and 

Y CL gY<Y CH 
can be set as the limits. 

When a (Xc,Y c ) outside these limits is obtained, the approximate center is set to the value closest to the limits 
20 of the approximate center. In other words, 
when Xc < Xa, Xc = Xcl is set 
when Xc > X CH . Xc = X CH is set 
when Y c < Y CL , Y c = Y CL is set 
when Y c > Y CH , Y c = Y CH is set 

25 

VI. Thinning 

A digital image is, when binarized, shown by black and white pixels. However, the symbol value which is 
the value of the respective degrees of brightness of the black and white pixels is preset. Furthermore, in the 

30 method according to the present invention, pixels known as "unresolved pixels" (a pixel which has not been 
distinguished as a black or white pixel) are present. However, the symbol values with respect to these unre- 
solved pixels are also pre-set. Although in this invention, thinning is executed for black pixels, whether the black 
pixel has a high or low degree of brightness is determined by the image desired, its method of input, the pres- 
ence or absence of a reversal of brightness, etc. For all of these situations, the section to be thinned will be 

35 called a "black pixel", and anything else will be called a "white pixel". FIG.2(a) shows the condition of the image 
data stored in image memory 4. The gray scale image obtained from information input from input device 2 or 
a binary image (including the situation where a gray scale image is binarized) is stored in image 10 as the orig- 
inal image. In the connectivity of black pixels of a thinned image, which is the image resulting from thinning the 
original image 10, either 4- neighbor connected or 8-neighbor connected is used. In the embodiments of the 

40 present invention, 8-neighbor connected is used for connectivity of black pixels. An image undergoing the proc- 
ess of thinning and a thinned image (i.e., an image for which thinning has been completed) is stored in image 
1 1 for original image 10. FIG 2(b) shows the situation of the information which is stored in memory 6. Program 
and data for executing the method of the present invention are stored in program data 12. Decision data for 
thinning unresolved pixels are stored in unresolved pixel thinning decision data 14. FIG.3(a) shows an abbre- 

45 viation of a 3 x 3 pixel aggregation centered about pixel P 0 . For each pixel address, the address of P 0 is set 
to (X,Y), and the address of P, is (X+1.Y). of P 2 is (X+1.Y-1). of P 3 is (X.Y-1), of P 4 is (X-1.Y-1), of P 5 is (X- 
1.Y). of P 6 is (X-1.Y+1), of P 7 is (X.Y+1), and of P e is (X+1.Y+1). 

A preferred embodiment is given below of the situation where the X axis and lines parallel to it are used 
as one straight line Lx and its parallel lines, and where the Y axis and lines parallel to it are used as straight 

so line Ly, which rotates only a set angle above 0 degrees of straight line Lx, and as the lines parallel to Ly (i.e., 
the turning angle is 90 degrees). Additionally, each parallel line must be only a line passing through each co- 
ordinate. 

An example of the step which, in a binary image, classifies black pixels and white pixels which have un- 
dergone thinning processing, from unresolved pixels - pixels for which thinning is unresolved - is shown in pro- 
55 cedure A. An abbreviation of procedure A is shown is FIG.8. 
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Procedure A) 
Step A1 

5 In this step, each black pixel of the X axis and lines parallel to the X axis is classified as a black pixel, a 
white pixel or an unresolved pixel. For original image 10 which is the binary image stored in image memory 4, 
Y=Y 0 (Y o =0 l 1,2,...Y h ) is set. The connective region of black pixels at this point in time is set to X u ^ X ^ Xm 
(i=1,2,...). Because nothing is as of yet set in image 11 for the thinned image, original image 10 is duplicated 
to image 1 1 . Next, for the entire direction of X, 
10 (1) when a set value W is not satisfied, only the center point (the pixel in the decreasing direction of the X 
coordinate when the number of pixels of said interval is odd) of the division connected to the black pixel 
(i.e., the coordinates (X,Y 0 ) and the interval X u =i X ^ X H! for an i which satisfies Xhi - X u + 1 < W) is set 
as a black pixel for the division connecting to the black pixel of (W£2). Other pixels are set to white; and 
(2) all pixels in a division connected to a black pixel having a value above set value W are set as unresolved 
15 pixels. 

The above results are set to image 1 1 . 

Y 0 is increased by 1 and the processing of this step is carried out for all Y©. 
Step A2 

20 

In this step the connectivity of the coordinates {set to coordinate (Xo,Y 0 )} of the pixel which is set as a black 
pixel and the connectivity of the black pixel of the X axis and lines parallel to the X axis for Y=Y 0 -1 where Y is 
the Y coordinate of the pixel immediately preceding the first black pixel is checked for image 1 1 (original image 
10 is also referred to). Processing for connectivity is carried out as necessary. In other words, for the domain 
25 0 ^ Y 0 ^ Y h , in order to connect a black pixel or an unresolved pixel of Y=Y 0 which is currently being processed, 
to the black pixel or the unresolved pixel of Y=Y 0 -1, the coordinate of the black pixel and the unresolved pixel 
is set to (Xo,Y 0 ) and the following process is carried out 

(1) If one or more of the coordinates of (Xo-1, Y 0 -1) f (X<>, Y 0 -1) or (Xo+1, Y 0 -1) is a black pixel or an unre- 
solved pixel, since it is connected to (Xo,Y 0 ), the processing of this step ends. Or, 
30 (2) when there are no black pixels or unresolved pixels in the coordinates of (Xo-1,Y 0 -1), (Xo, Y 0 -1) and 

(Xo+1 ,Y 0 -1 ), (X 0 -2,Y 0 -1 ) is checked as to whether or not it is a black pixel or an unresolved pixel. When is 
is a black pixel or an unresolved pixel, and (Xo-1,Y 0 ) is set as a black pixel to connect (X 0 -2 f Y 0 -1) with 
(Xo,Y 0 ). Additionally, similar processing is earned out for (Xq+2, Y 0 -1). Following this, similar processing is 
carried out on (Xo-R,Y 0 -1) t (Xq+R, Yq-1). Checking is conducted up to (Xo+R, Y 0 -1), and when no black or 
35 unresolved pixels are discovered, conditions are set as is. Connectivity search region R is a pre-set para- 

meter. Next, step A2 is repeated for all of (Xo,Y 0 ) under examination. 

Next, an unresolved pixel generated by the results of execution of procedure A (in the case of a gray scale 
image, the results of execution of procedure BZ), and an example of the step of thinning for the Y axis and 
lines parallel to it is shown. In step T, for unresolved pixels in image 1 1 for which the processing of step A has 
40 been completed, the connectivity to the black pixel which has been connected to the above unresolved pixel 
is maintained, unresolved pixels are classified from black and white pixels, and a thinned image is produced. 
A summary of step T is shown in FIG.9. 

[step T] 

45 

Step T1 : 

In this step, the pixel of the center point of the interval in which the unresolved pixels are connected in the 
Y direction is changed to a black pixel or a white pixel. When a plurality of separated unresolved pixels which 
so are above the same X coordinate are present, processing is carried out starting from the unresolved pixel having 
the smallest Y coordinate. First, one unresolved pixel to be processed is selected from the direction in which 
X is small (X=Xo). Next, starting from the direction of a small valued Y, the pixels of the Y direction when X=Xo 
are checked and, from among those domains in which one or more connected unresolved pixels appear, one 
domain is selected. This interval is set to X=Xo and Y T ^ Y m Y B (Y T is the upper tip of the connective interval 
55 of the unresolved pixel and Y B is the lower tip of the connective interval of the unresolved pixel). Next, 

(1) When Y B -Y T = 0 or 1 (i.e., when the connective interval of the unresolved pixel in the Y direction is one 
or two), the thinning decision procedure for unresolved pixels (procedure H) is processed as the coordin- 
ates of the unresolved pixels of the initial point (Xo,Y r ), and as the coordinates of the unresolved pixels of 
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the final point (X<>,Y B ), and the processing, of step T1 and step T2 are ended for this interval. Furthermore, 
(2) When Y B -Y T £ 2, only the center point of the connective interval of this unresolved pixels (when the 
number of connected pixels is an odd number, the pixel closest to the center point with the smaller Y co- 
ordinate) is set as the black pixel of the center point (Xc,Y M ) of the connective interval of the unresolved 
5 pixel, and then step T2 is proceeded to. 

Step T2 

In this step, the connectivity between the center point in the Y direction of the unresolved pixel aggregation 
10 and the black pixels which are adjacent above, below, to the right and to the left (left includes the left horizontal 
in the upper and lower direction and right includes the right horizontal in the upper and lower direction) of this 
unresolved pixel aggregation is maintained, and thinning process which changes each unresolved pixel into a 
black pixel or a white pixel is carried out. In other words, (Xo,Y 0 ) is set to the black pixel of the center in the Y 
direction of the unresolved pixels, and thinning, which maintains the connectivity of the black pixels horizontally 
15 adjacent to and to the left and right of an unresolved pixel of an interval of X=X<> and Y T ^ Y ^ Y B , and which 
maintains the connectivity of the black pixels vertically adjacent to and above and below an unresolved pixel 
of this same interval, is carried out according to the following process. 

(a) The Y coordinate (Y y ) of the black pixel in the uppermost position among the horizontally adjacent black 
pixels to the right and left is obtained by the following process. In other words, coordinate (Xo.Yt.,) is 

20 checked as to whether or not it is a black pixel (upper vertically adjacent black pixel), and, when it is a black 

pixel, is set to Yu=Y r 1 and (b) is proceeded to. When coordinate (Xo,Yt-1) is a white pixel: 

(1) In X= Xq-1, the black pixel which is in the domain of Y r 1^Y^YM-1 is investigated sequentially from 
the small direction of Y, and the coordinate (Xq-1 ,Y ul ) of the upper left adjacent black pixel for which 
the Y coordinate is smallest is obtained. When said pixel does not exist, Y UL = {$} is set. Here, {<)>} indi- 

25 cates an empty aggregation. Next, (2) is proceeded to. 

(2) In X= Xo+1 , the black pixel in the limits of Yt-1 £ Y=i Ym-1 is investigated sequentially from the di- 
rection of a small value for the Y coordinate, and the coordinate (Xq=1 ,Y ur ) of the upper right horizontally 
adjacent black pixel for which the Y coordinate is smallest is obtained. When said coordinate does not 
exist, Y UR = {<|>} is set. Next, (3) is proceeded to. 

30 (3) Y y = MIN (Yul.Yur) is setand (b) is proceeded to. Here, MIN(. f .) is the smaller of two numbers. When 

the two numbers are identical either may be selected. In the case where one of the numbers is the empty 
aggregation, the other number is selected. When both numbers are empty aggregations, Yu= {$}. Next, 
(b) is proceeded to. 

(b) The Y coordinate (Y 0 ) of the black pixel in the lowest position among the horizontally adjacent black 
35 pixels to the left and right is obtained according to the following process. In other words, coordinate 

(Xo,Y B +1) is checked as to whether or not it is a black pixel (the lower vertically adjacent black pixel). From 
this result, when (Xo,Y B +1) is black Y D =Y B +1 , and (3) is proceeded to. When (Xo,Y B +1 ) is white, the following 
(1 ) is proceeded to. 

(1) In X=Xo-1. the black pixel in the limits of Y M +1 ^ Y ^ Y B +1 is sequentially investigated from the di- 
40 rection of a large value Y coordinate, and the coordinate (Xo-1 ,Y DL ) of the lower left adjacent black pixel 

for which the Y coordinate is largest is obtained. When said black pixel does not exist, Y DL ={<t>}, and (2) 
is proceeded to. 

(2) In X=Xo+1, the black pixel in the limits of Y M +1 ^ Y ^ Y B +1 is sequentially investigated from the 
direction of a large value Y coordinate, and the coordinate (Xo+1,Y DR ) of the lower left adjacent black 

45 pixel for which the Y coordinate is largest is obtained. When said black pixel does not exist, Y DL ={<|>}, 

and (3) is proceeded to. 

(3) Y d =MAX(Ydl.Y dr ) and (c) is proceeded to. Here. MAX(.,.) is the larger of two numbers. When the 
two numbers are identical, either may be selected. In the case where one of the numbers is the empty 
aggregation, the other number is selected. When both numbers are empty aggregations, Y D = ($). Next, 

so (c) is proceeded to. 

(c) The process of converting unresolved pixels which are not related to adjoining black pixels to white pix- 
els is carried out In other words, in X=Xo, 

(1) when Yu is an empty aggregation, each unresolved pixel of Y T ^ Y ^ Ym-1 is set to a white pixel 
and (2) is proceeded to. When Yu is not an empty aggregation and when Y T ^ Yu, each unresolved 

55 pixel of Y T s Y ^ Yy is set to a white pixel and (2) is proceeded to. When this is not the case, (2) is 

proceeded to without anything being done. 

(2) When Y D is an empty aggregation, each unresolved pixel of Y M +1 ^ Y ^ Y B is set to a white pixel 
and (2) is proceeded to. When Y D is not an empty aggregation and when Y D % Y Bt each unresolved 
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10 



30 



40 



55 



pixel of Y D ^ Y ^ Y B is set to a white pixel and (d) is proceeded to. When this is not the case, (d) is 

proceeded to without anything being done, 
(d) In this step, processing of unresolved pixels for which it is necessary to maintain their connectivity with 
the black pixels adjacent above, below, to the left or to the right is carried out. In other words, according 
to the thinning decision procedure for unresolved pixels (procedure H) recorded below, the unresolved pixel 
of the divisions of 

X = X<>, Yy + 1±iY=§Y M -1 and Y M + 1 % Y=£ Y D -1 
are converted to black or white pixels. Here, when Y y or Y D is an empty aggregation, they are set to be 
outside the interval included in the parameters. Next, the results are stored in image 1 1 and step T2 ends. 



Step T3; 



Steps T1 and T2, which comprise procedure T, are carried out for the interval in the Y direction for which 
unresolved pixels of a single X are to be connected. Additionally, X is increased and the same process is re- 
ts peated for all unresolved pixels. 
(End of procedure T) 

FIG. 10 is an example of an unresolved pixel and its thinning FIG. 10(a) shows the thinning of an aggre- 
gation of the unresolved pixels resulting from procedure A, and of the black pixels which are to be connected 
to these. FIG. 10(b) shows the result of thinning of unresolved pixels according to procedure T (the dotted line 

20 is the outline of the original aggregation of unresolved pixels which do not exist in reality but were noted for 
the purpose of explanation). 

An example of the thinning decision process for unresolved pixels which is used in step T is shown in the 
following procedure H. An example of a table which has the thinning decision data 14 for unresolved pixels of 
memory 6 used in procedure H is shown in FIG. 12. As shown in the table of FIG. 12, central processing device 

25 5 carries out inspection through a relative position given from the table head, without relative position number 
Q given from the head of the table being stored in the data in image processing device 1. An abbreviation of 
procedure H is shown in FIG. 11 



Procedure H1] 
StepHI: 



Coordinates (Xq,Y) of the unresolved pixel of an initial point and coordinates (Xo.Y) of the unresolved pixel 
of a final point for thinning process image 1 1 are obtained as input information related to this step. Here, 
35 Y coordinate of unresolved pixel at initial point ^ 

Y coordinate of unresolved pixel at final point, and, 

X coordinate of unresolved pixel at initial point = Xo must be true. Furthermore, progressing in the Y di- 
rection, all of the pixels from the unresolved pixel of the initial point to the unresolved pixel of the final point 
must be unresolved pixels. 



Step H2: 



For the interval of unresolved pixels in the Y direction, the following process is carried out sequentially on 
P 0 . beginning with the initial point of the unresolved pixel of the center of the pixel aggregation (P 0 ) through the 
45 final point in a 3 * 3 pixel matrix, in the increasing direction of Y and depending on the 8 neighboring pixels. 
The bit values for an unresolved pixel (P 0 ) which is to be thinned and for its eight neighboring pixels (P1 ~~P8) 
are set as white pixel=0, black pixel=1 , and unresolved pixel prior to thinning=1 , and the relative position number 
Q of the item (individual elements of the table will be called "item") of the thinning decision data table for un- 
resolved pixels is according to the following 

so q = p 8 H p 7 ILIlPi 

( | | indicates a concatenation. In this case, a hexadecimal indicator, the region for which Q is obtained is 00- FF 
(in the table in FIG.4, Q becomes the hexadecimal indicator)). 



Step H3 

Because the value of Q becomes the item number of the table in thinning decision data 1 3 for an unresolved 
pixel, the position of the item in the table of thinning decision data 13 for an unresolved pixel is obtained directly 
from Q (Q = relative address from the table head = item number X size of one item). Next, according to the 
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conversion assortment of the thinning decision data for an unresolved pixel, processing is carried out for an 
unresolved pixel P 0 Processing for a conversion assortment of the table (the setting of the black and white pixels 
is carried out directly following the completion of a decision for a P 0 ) is as follows. At conversion assortment 
00, unresolved pixel P 0 is converted into a white pixel, at conversion assortment 01, unresolved pixel P 0 is con- 

5 verted into a black pixel. 02, 03 are separate processes. At conversion assortment 02, unresolved pixel P 0 is 
converted into a black pixel and, additionally, P 3 is converted into black pixel. At conversion assortment 03 un- 
resolved pixel P 0 is converted into a white pixel and P 5 is converted into a black pixel Additionally, in response 
to the character and objective of the desired image, the processing for these conversion assortments can be 
renewed and a conversion assortment can be supplemented. As a result of the above, image information in 

10 which an unresolved pixel of an indicated region has been converted to a blacker white pixel is output to thinning 
process image 1 1 of image memory 4. 
(End of procedure H) 

In FIG. 1, image memory 4 may be combined with memory 6. Furthermore, in the case where an input de- 
vice which directly obtains a digitalized image is used, AID converter 3 may be abbreviated. In the preferred 

15 embodiments of the present invention, a pixel aggregation of a 3 x 3 arrangement is used in the thinning decision 
table for unresolved pixels. However, the method of the present invention may also be appropriately applied 
to a pixel aggregation of an N x N matrix (N=2,3,4,5,...). The allotment of the program and hardware in the pres- 
ent invention is optional. The method of setting the value of the fixed value W in procedure A is optional and 
there are, for example, the method of presetting, the method of measuring from the desired image, and the 

20 like. It is necessary to renew the table of thinning decision data for unresolved pixels in FIG.4 in response to 
the characteristics of the image, the objective of the thinning and the method of setting straight lines Lx, Ly. 
Smoothing or correction may be carried out beforehand on a binary image or a gray scale image for which thin- 
ning processing is to be carried out The value of set value W in step A1 of procedure A is set using the char- 
acteristics of the image (for example, the line widths constructing the image). In the preferred embodiments of 

25 the present invention, 8-neighbor connected connectivity is used. However, this can be changed to the case 
where 4-neighbor connected connectivity is used. In the case where the quality of the thinned image obtained 
in procedure T is insufficient, in place of procedure T, which is the second process of the method of the present 
invention, an optional method {such as the thinning method of Hiiditch (for example "Multi-sided Image Proc- 
essing and Related Software System Research", Tamura et al., Research Report of Electrotechnical Labora- 

30 tory), No.835,1984} can be appropriately used. 

In procedure A, when section ally ignoring connectivity and carrying out approximate thinning, step A2 of 
procedure A is omitted. In procedure T, when section ally ignoring connectivity and carrying out approximate 
thinning, the thinning decision data for an unresolved pixel can be set without giving consideration to the con- 
nectivity. 

35 An example of the process of classifying the black pixels, the white pixels and the unresolved pixels for 

which thinning is unresolved, is shown in step BZ for the case where simultaneously carrying out thinning and 
binarization of a gray scale image and obtaining a thinned image. In this case, a thinned image is stored in 
original image 10. (According to the application of the procedure T to the executed results of procedure BZ, in 
the same manner as the case where procedure T is applied to procedure A, it is possible to obtain a thinned 

40 image for which thinning has been completed) 

The differential value AX in the direction of X in the coordinate (X,Y), 1 =5 X =s Xhh -1 is shown by the following 
differential equation. 

AX = f(X + 1,Y)-f(X-1,Y) 

Here, because AX is the boundary of the coordinate when X=0 and X=Xh, it does not exist. The differentiated 
45 value AY in the direction of Y in the coordinate (X,Y), 1 ^ Y =i Y h -1 is shown by the following differential equation. 

AY = f(X.Y + 1M(X,Y-1) 

Here, because AY is the boundary of the coordinate when Y=0 or Y=Y h , it does not exist (The differential 
value may be defined by some other method.) 

50 [Procedure BZ] 

Step BZ 1 : 

Here, original image 10 is classified into one or more sub-divisions, and the average brightness value is 
55 obtained for each division. In other words, one sub-division is set to the quadrangular division of 

X s ^ X ^ X s + Xl-1, and Y s ^ Y £ Y s + Y L -1 
Said average brightness of the sub-division = 
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YS+YL-1 

ZXS+XL-1 
[( I f (X, Y) ) /X.] / Y-_ 

x«xs 

Y=YS 



Step BZ 2: 



In this step, thinning according to an investigation in the X direction, is carried out as follows. According to 
this step BZ 2, sections other than unresolved pixels are processing in the X direction. 

(a) The brightness distribution of the X direction is checked when Y is set to a fixed value Y 0 (Y 0 changes 
sequentially from 0 to Y h ) and the minimum and maximum are obtained by the following (1) and (2). Fol- 
lowing this, (b) is proceeded to. 

(1) Minimum 

Because the smallest point in Y=Y 0 fulfills all of the following conditions, first condition S1 is 
checked and a candidate for the minimum is obtained. Next, when this candidate for minimum fulfills 
the S2 conditions, the X having the minimum is obtained. A minimum indicates a black pixel. 

[condition S1] The candidate for a minimum is the X coordinate having the smallest degree of 
brightness within X, X+1, and X-1 which are the neighborhoods of the X coordinate, the differential of 
which changes from negative to positive. 

[condition S2] The brightness of the candidate for a minimum is less than the average value of 
the brightness of the sub-division associated with this pixel. 

(2) Maximum 

Because the maximum in Y=Y 0 fulfills all of the following conditions, first, condition L1 is checked 
and a candidate for the maximum is obtained. Next, when this candidate for the maximum fulfills the 
L2 conditions, the X having the maximum is obtained. The maximum indicates a white pixel. 

[condition L1] The candidate for a maximum is the X coordinate having the greatest degree of 
brightness within X, X+1, and X-1, which are the neighborhoods of the X coordinate, the differential of 
which changes from positive to negative. 

[condition 12] The brightness of the candidate for the maximum is greater than the average value 
of the brightness of the sub-division associated with this pixel. 

(b) In Y=Y 0 , the X values of the X having a minimum and maximum obtained in (1), are lined up in order 
of small X, 

(1) For an X which is a minimum immediately preceded and followed by maximum points, and which 
satisfies the following, 

(brightness of immediately preceding maximum pointbrightness of minimum point) ^ V, and 
(brightness of immediately proceeding maximum pointbrightness of minimum point) £ V, 
the pixel of (X,Y 0 ) is set to black. Here, V is a predetermined number. Next, (2) is proceeded to. 

(2) X in which continuous minimum points other than those of (1) above appear, are set as an unresolved 
pixel and the data of the pixel joining these is set to the data of the unresolved pixel. Furthermore, the 
region of the unresolved pixel (X coordinate of the left margin and the X coordinate of the right margin) 
is memory stored. Next (3) is proceeded to. 

(3) Pixels in Y=Y 0 other than the above (1) and (2), are all set to white pixels. Next, III is proceeded to. 

(c) Here, for image 1 1, the connectivity of the black pixels of the X axis and of lines parallel to the X axis 
is checked for the coordinates of the pixel set to a black pixel (set to coordinate (Xo,Y 0 )) and the immediately 
preceding Y coordinate, Y=Y 0 (original image 10 is also referred to), and if necessary are connected. In 
other words, the same processing as step A2 of procedure A is carried out. 

(End of procedure BZ) 



VII. Procedure for Nanrowization Processing 



Aggregations of one or more black pixels are treated as the lines of an image. The method of maintaining 
the designated value of the line width is optional, and both the method of maintaining the designated value of 
the line width as input information of the nanrowization process and the method of maintenance within the nar- 
rowization process are possible. It is also possible to maintain one or more designated line width values within 
a single nanrowization processing procedure. In the preferred embodiments of the present invention, the pro- 
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cedure of nanrowization processing can be appropriately used in response to the designated value of the line 
width. However, image processing device 1 can be equipped with only a narrowization processing procedure 
for the designated value of the line width corresponding to the first image and with a narrowization processing 
procedure corresponding to the second image. An example of a narrowization processing procedure which re- 
5 lies on the designated value of the line width follows below 

(1 ) Narrowization Processing for Setting the Majority of the Line Widths to the Width of One Pixel (the des- 
ignated value of the line width is one pixel) 

It is possible to use a conventional method (i.e., a narrowization method which can set the majority of 
the line widths to the width of one pixel) as a procedure for narrowing the line width of a binary image (or 
10 a procedure for binarizing a gray scale image and narrowing the line width). Furthermore, there are also 
methods for directly binarizing and narrowing a gray scale image. 

(2) Narrowization Processing for Narrowing the Majority of the Lines to a Width Below the Value of a Des- 
ignated Line Width (the designated value of the line width is an optional numeric value) 

This may be realized by the conventional method. For example, a method such as the following is available. 
15 a) In the case of a narrowization process in which the process of removing the components of a line one 
pixel at a time is repeated from the outer side of a line which comprises an image (in the preferred embodi- 
ments of the present invention, corresponding to the black pixels which are the fingerprint lines) until the 
majority of the line widths have become one pixel, the repetition number in the narrowization process may 
be set so that 

20 Repetition Number = (largest line width of the original binary image) - (designated value of line 

width )/(approximate value of the number of pixels which are to be deleted each line width by line width by 
means of deletion processing of a section of an image plane) 
b) A Narrowization Method Wherein Black Pixels are Left Out of the Center of the Line Components Which 
Compose an Image 

25 For the black pixels above the line segment of a section where an optional straight line and the line of an 

image intersect, narrowization can be accomplished through keeping the black pixels below the indicated value 
of the line width which indudes the center of said line segment (in the case where the line segment width is 
above the indicated value for the line width, the center point of the line segment is set as the center and the 
black pixels of the indicated value of the line width are kept and all of the black pixels above the line segment 

30 for which the line segment width does not satisfy the indicated value of the line width are kept). 
A concrete example of the procedure is shown in procedure F. 

In the preferred embodiments of the present invention the situation is disclosed wherein the X axis and 
lines parallel to it are utilized as one straight line L x and its parallel lines, and the Y axis and lines parallel to it 
are used as a straight line L Y and its parallel lines, this line L Y forming an angle of a fixed degree greater than 
36 0 degrees with straight line L x (i.e., the turning angle is 90 degrees). A parallel line will be only a line which 
passes through each coordinate. The input information of procedure F is the image input information. The output 
information is the output image. 

(Procedure F) 

40 

Step F1 (narrowization processing in the X direction): 

In this procedure, black pixels above the X axis and lines parallel to it, are reclassified into white and black 
pixels. For image 10, Y=Y 0 (Y 0 =0,1,2,...Y h ). and the limits of the connectivity of the current black pixels is set 

45 to X u ^ X ^ Xni (i=1 ,2,...). Next, with respect to the entire X direction, for the sections of connected black pixels 
which are above the indicated value wx of the line width (i.e., the interval of the line segment X u ^ X ^ X Hi 
which is the coordinate (X.Y 0 ) for an i satisfying XHrXu+ 1 ^ wj, when the length of the line segment (pixel num- 
ber) is greater than wx, wx black pixels are kept about the center point of the line segment, and all black pixels 
which are above the line segment for which the length of the line segment is less than wx are kept. 

so The above results are set in image 10. Yr is increased by one, and this procedure is carried out for all Y 0 . 

Step F2 (narrowization processing in the Y direction): 

In this procedure, black pixels above the Y axis and lines parallel to it, are reclassified into white and black 
55 pixels. For image 10, X=X 0 (Xo=0,1 ,2,...X h .), and the limits of the connectivity of the current black pixels is set 
to Y u ^ Y ^ Y H i (i=1 ,2,...). Next, with respect to the entire Y direction, for the sections of connected black pixels 
which are above the indicated value wy of the line width (i.e., the interval of the line segment Y u m Y ^ Y Hi 
which is the coordinate (X 0 ,Y) for an i satisfying Y H rY L Ki + 1 - w y ), when the length of the line segment is greater 
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than wy, wy black pixels are kept about the center point of the line segment, and all black pixels which are above 
the line segment for which the length of the line segment is less than wy are kept. 

The above results are set in image 10. Xo is increased by one, and this procedure is carried out for all 
(End of procedure F) 

5 c) After thinning, the line width of the image can be expanded. In the preferred embodiment of the present in- 
vention, when carrying out narrowization processing on a registered fingerprint image and a fingerprint image 
undergoing testing, the indicated value for line width can be optionally set. However, it is necessary to set the 
value on the basis of such factors as the quality and characteristics of the input image, the performance with 
respect to the indicated value for line width in narrowization processing, the performance demanded of image 

10 processing device 1 , etc. If the difference between the indicated values for line width in the narrowization proc- 
essing of a registered fingerprint and a tested fingerprint, respectively, is large, the errors in position matching 
of both images becomes considerable, and if this difference becomes too large, a decrease in the accuracy of 
the comparison sometimes occurs. Providing a smaller line width for the modified image of a registered finger- 
print allows the amount of memory required for registered information to be smaller due to the decreased num- 

15 ber of pixels. If the above is taken into consideration, either of the following indications will be effective. 

(1) In the narrowization processing of the registered fingerprint image, the indicated value of the line width 
is set to one pixel, and, in the narrowization processing of the tested fingerprint, the indicated value of the 
line width is set to an appropriate value greater than 2 pixels (for example, 3 pixels). 

(2) Values are selected appropriate to the condition wherein the indicated value of the line width for the 
20 narrowization processing of the modified image of a registered fingerprint is set to a value smaller than the 

indicated value of the line width of the tested fingerprint. 

In the following preferred embodiments, the situation given in the above (1) is recorded. 
VIII. Partial Conversion Processing of the Pixels of a Registered Image 

25 

The following effects are obtained due to the partial conversion of the black pixels of a registered image 
(i.e. the pixels to be processed) into white pixels in the limits which have no effect upon the accuracy of the 
comparison. 1) The processing quantity for the comparison decreases due to the decrease of the black pixels 
of the sub-template portion, and the file quantity of the recorded information decreases. 2) The file quantity for 
30 the recorded information is decreased due to the decrease of the black pixels of the non sub-template portion. 
In this step, omission of the comparison of the fingerprint is possible, and, in particular, it is possible to reduce 
the file quantity and processing quantity when necessary. 

Procedure D is an example of the process to convert black pixels of the registered image into white pixels. 

35 (Procedure D) 

Step D1 (processing in the X direction) : 

Y= a • j, (0 ^ X £ X h ; 0 ^ Y ^ Y h ; a is a predetermined number (2sa< X h ); j=0,1 ,2 ), the above black 

40 pixels are converted into white pixels. 

Step D2 (processing in the Y direction) : 

X= b ■ /, (0 =s X ^ X h ; 0 =i Y ^ Y h ; b is a predetermined number (2 ^ b < X h ); j=0,1 .2 ), the above black 

45 pixels are converted into white pixels. 
(End of procedure D) 

Additionally, in procedure D, 
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partial (Number of black pixels of registered 

conversion^ information following partial 

rate conversion number >/ (Number of black 

pixels in original binary image) 



10 * { (a-1) /a} • ( (b-1) /b} . 

In the limits which have no effect upon the comparison accuracy (for example, 0%-20% for the complete 
body), due to the conversion of black pixels into white pixels, the data quantity of recorded information is re- 
ts duced only by the portion of the black pixels which are converted within the template. The quantity of the com- 
parison processing is reduced only by the quantity of the processing to the black pixels converted within the 
template portion. 

IX. Process for Recording the Registered Information of a Registered Image 

20 

The process of recording fingerprint information involves the process of extracting sub-template RT(0) and 
non sub-template RB(0) from the registered fingerprint image Rth in image 10, which results from the input, as 
the registered fingerprint, of image memory 4 to image 10, the carrying out of processing through narrowization 
processing, and then the storing of template RT(0) and non sub-template RB(0) in each file. The steps for car- 
25 rying out the recording process of the fingerprint information are shown in procedure R. The input information 
of procedure R is the file name of the sub-template and non sub-template of the registered fingerprint, the reg- 
istered fingerprint image Rth, the fingerprint boundary information of the registered fingerprint and the approx- 
imate center point of the registered fingerprint (x RC ,Y RC ). The output information of procedure R is the file of 
the sub-template RT(0) and the file of the non sub-template RB(0). 

30 

(Procedure R) 

Step R1 (formation of sub-template RT(0)): 

35 Black pixel addresses within the fingerprint area and in the limits of sub-template RT(0) are extracted from 

registered fingerprint variable image Rth, and the file of sub-template RT(0) is formed. In the file stored in RT(0), 
the approximate center point of the registered fingerprint (Xr C , Y rc ) is also stored. 

Step R2 (formation of non sub-template RB(0)) 

40 

A black pixel address which is outside sub-template RT{0) and within fingerprint area FA is extracted from 
the transposed recorded fingerprint image Rth, and the file of non sub-template RB(0) is formed. 
(End of procedure R) 

The method of storage of each file of the sub-template and the non sub-template is optional. For example, 
45 data may be compressed and stored in a file and, at utilization, data elongation may be carried out 

X. Memory Processing of Image Data 

When storing the address of each black pixel (X,Y) as is in a file, the quantity of storage memory necessary 
so is as follows: 

Storage memory quantity = (Number of black pixels) - ((Memory quantity for x coordinate unit) + (Memory 

quantity for Y coordinate unit)) 
It is necessary to memory store respectively information regarding the sub-template and the non sub-tem- 
plate in file for a registered fingerprint image. Examples are shown in the following M1 , M2, or M3, of the process 
55 for carrying out compression and storage in file when storing as is the black pixel addresses of the binary image 
data. 
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Method M1 

The pixel aggregation recorded herein is for the case of a 3 * 3 pixel matrix. A 3 x 3 pixel aggregation is 
shown in FIG. 3(a). An example of a part of the image data is shown in FIG. 13. A representative pixel is set to 
5 P 4 and the classification of each pixel as black and white pixels within the pixel aggregation is indicated by bits. 
According to, 

G = P 8 I I P 7 I I P 6 1 1 P 5 I I P 3 I I P 2 I I Pi I I Po 
(I | indicates concatenation. Representative pixel P 4 is not included in G) 

the black and white condition of each pixel can be shown by the neighboring pixel code G of 1 byte (hexadecimal 
10 digits 00-FF). Pa is the bit of the surplus of the X coordinate address part, and indicates the classification be- 
tween the white and black pixels (for example, when the X coordinate address is 1 byte, (X coordinate ad- 
dress/3) is indicated by 7 bits and the classification of white and black pixels of representative pixel P 4 is 
indicated by other bytes). 

Next, according to representative pixel P 4 = (X*,Y 4 ) and its relative position, pixel address (X,Y) becomes 
15 as follows. 

P 0 : X=X4+1,Y=Y 4 +1 

P,: X=X4+2, Y=Y 4 +1 

P 2 : X=*4 +2, Y=Y 4 

P 3 : X=X 4 + 1,Y=Y 4 
20 P 4 : X=X 4 , Y=Y 4 

P 6 : X=X4, Y=Y 4 +1 

P 6 : X=X4, Y=Y 4 +2 

P 7 : X=X4+1 Y=Y 4 +2 

P 8 : X=X4+2, Y=Y 4 +2 

25 Next, compression processing will be explained. At the time of compression, the (X,Y) coordinates of the 

image data are converted to the following form. For the area within the activated region of the fingerprint, each 
third X coordinate is set to each third Y coordinate as the representative pixel and a check is made of whether 
or not there are any black pixels in the 3 x 3 pixel aggregation (initial point, etc. depends on the setting of the 
pixel aggregation). Only when black pixels are present are the X coordinate of the representative pixel and the 

30 pixel aggregation code memory stored. (For elongation, the opposite process may be carried out). The storage 
method of the storage media is as follows. 



Y=3j: stored X coordinate set number 

{ (P4 B/W classification bit (initial 1 
bit) + (X coordinate of the representative 
pixel aj/3)), pixel aggregation code), 
(P4 B/W classification bit (initial 1 
bit) + (X coordinate of the representative 
pixel bj/3)), pixel aggregation code), 



is set (j=0,1 ,2,...). In place of the stored X coordinate set number of the black pixel, a termination sign of the X 
coordinate values with respect to the value of each Y coordinate may also be added. Here, the Y 0 coordinate 
of the stored X coordinate set number which is equal to zero is packed without being set. A 3 x 3 pixel aggre- 

so gation in which all of the pixels are white is jumped. Although a 3 x 3 arrangement is recorded herein for the 
pixel aggregation, this can be optionally set (for example, 4x4 pixels, 5x3 pixels, etc.). The position of the 
representative pixel within each pixel aggregation can be optionally set. In order to judge whether the repre- 
sentative pixel is black or white, an indicator may be added for one of the black/white pixel dassification. The 
initial boundary and length (RT(0) and RB(0) in these embodiments) of the image data is set so as to become 

55 a three time larger number. 

Remarks: An example of the data reduction ratio in method M1 of the image data compression step follows. 

The X and Y coordinates of the original image are indicated respectively by 1 byte (because it is a binary 
image it is possible to indicate the degree of brightness by one bit, however, when so doing, the access proc- 
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essing quantity becomes large), and the case where the brightness is stored by one byte is compared to. For 
the domain of one pixel aggregation, 

Data reduction ratio 
= (Data quantity following compression)/(Original data quantity) 
5 = {(probability of there being one or more black pixels in a 3 x 3 pixel aggregation) x {(memory quantity 
for storage of the X coordinate) + (memory quantity for storage of B/W pixel classification) + (memory 
quantity for storage of neighboring pixel codes}]/{(number of pixels in pixel aggregation) x (memory quantity 

for storage of pixel units)} 

and the probability that there are one or more black pixels in a pixel aggregation is X. When the memory stored 
10 quantity of the black and white pixel classification of the representative pixel is set to 1 byte (although 1 bit is 
permissible, the region is set to 1 byte), 

Data reduction ratio = 2X79 
(when X=0.1, the data reduction ratio is, for example, 0.0222, and, when X=0.05, is 0.01 11). 

15 Method M2 

The pixel aggregation recorded herein is for the case of a 4 x 4 matrix of a pixel aggregation. A 4 x 4 pixel 
aggregation is shown in FIG. 3 for optional representative pixel P 0 . The black and white classification of each 
pixel is shown by bits. The black pixel condition and the white pixel condition of each neighboring pixel :an be 
20 shown by the 2 byte pixel aggregation code G (0000-FFFF by hexadecimal digits), according to 
G = Pis I I Pu I I Pu I I . - . I I P 7 I I Pe I I P5I I P4 I I Pa I I P2 I I Pi I I Po- 
Next, depending on representative pixel P 0 =(Xo,Y 0 ) and its relative position, pixel address (X,Y) becomes 





as follows: 




Pv 


X=Xo-1,Y=Y 0 


25 


Pi- 


X= X 0 -2, Y= Y 0 




P 3 : 


X= Xq-3, Y= Yq 




P 4 : 


X= Xo, Y= Y 0 -1 




P 6 : 


X= Xo-1, Y= Y 0 -1 




P 6 : 


X= Xo-2, Y= Y 0 -1 


30 


P7: 


X= Xo-3, Y= Y 0 -1 




P 8 : 


X= Xo, Y=Y 0 -2 




P 9 : 


X=Xo-L Y=Y 0 -2 




P10: 


X= Xo-2, Y= Y 0 -2 




P11: 


X= Xo-3, Y= Y 0 -2 


35 


P«: 


X = Xq, Y = Yq_3 




P«: 


X= Xo-1, Y=Y 0 -3 




P 14 : 


X= Xo-2, Y= Y 0 -3 




Pis: 


X= Xo-3, Y= Y 0 -3 



The compression processing of the registered fingerprint image data is the process of converting the (X,Y) 
40 coordinate of the registered fingerprint image data (X= 0-X h ,Y= 0~~Y h ) to the following form. For the area within 
the activated region of the fingerprint, each fourth X coordinate is set to each fourth Y coordinate as the rep- 
resentative pixel and a check is made of whether or not there are any black pixels in the 4 x 4 pixel aggregation 
(initial point, etc., depends on the setting of the pixel aggregation). Only when black pixels are present is the 
X coordinate of the representative pixel and the pixel aggregation code memory stored. In other words, the file 
45 storage form is set to 



50 



55 
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Y= 3+4 j: X coordinate set number of black pixels 

{ (X coordinate of representative pixel aj, 
pixel aggregation code), (X coordinate of 
representative pixel b-:, pixel aggregation 
code) , 

. . .} 

10 



(j= 0,1 ,2,...). In place of the X coordinate set number of black pixels, a termination sign of the X coordinate values 
15 with respect to the value of each Y coordinate may also be added. The Y coordinate is stored one time only 
for only the case where there is a black pixel of the X coordinate (i.e., when the number of sets of stored X 
coordinates is 0, the Y coordinate is packed without being set). A 4 x 4 pixel arrangement in which all the pixels 
are white is excluded. 

In elongation processing, with respect to the compressed registered fingerprint image data, when reading 
20 out the file, elongation towards the form of (X,Y) (the opposite process of compression) is carried out. Addi- 
tionally, the boundary information of the fingerprint is obtained from the right and left margin of the X coordinate 
value with respect to each Y coordinate value for, for example, the compressed file storage form of RB(0). 

Method M3 

25 

When the pixel aggregation consists of only one pixel, the non-representative pixel is an empty aggregation 
and in this case the memory form is set to, 

30 {value of Y coordinate Y=j, the number value of X 

coordinate of black pixels; X coordinate ji of black 
pixel, X coordinate j/ of black pixel,...} 

35 



(j= 0,1,2,...). Here, only for the case where there is a black pixel of the X coordinate is the value of the Y coor- 
dinate read one time only. 

40 Additionally, in place of the X coordinate number value of the black pixel, a termination sign of the X coor- 

dinate values with respect to the value of each Y coordinate may also be added. 

XI. Comparison Processing of Registered Image and Tested Image 

45 Comparison processing is the process of checking the concordance of each black pixel of a black pixel 
aggregation in a image (modified image) of a fingerprint undergoing testing, this fingerprint having been input 
to image 10 of image memory 4 as a fingerprint to be tested and having undergone all processes through nar- 
rowization processing, to each black pixel in a black pixel aggregation which has been stored in memory 6 as 
recorded information related to a registered fingerprint 

so Narrowed images (or fingerprints) are called modified images (or fingerprints). However, "narrowed 1 ' and 

"modified" are omitted in many cases. Coordinate conversion which relies on rotational and parallel displace- 
ments in order to position match a registered fingerprint and a tested fingerprint, can be carried out for either 
image. However, in the preferred embodiments herein, in order that the set value of the line width of narrowi- 
zation processing is smaller in the recorded fingerprint for the area within the fingerprint area, the number of 

55 black pixels is assumed to become small and the registered image is moved and matched to the image under- 
going testing. 

What follows is a summary of comparison processing. 
(1) Comparison using the Sub-template (first comparison) 
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The comparison of the sub-template is the process of obtaining the position at which the black pixels 
of the image of the registered fingerprint and the black pixels of the image of the fingerprint undergoing 
testing have the greatest degree of concordance. In other words, first, a sub-template RT(0,H,V), in which 
the approximate center of the registered fingerprint has been matched to the approximate center of the 

5 fingerprint undergoing testing, is obtained for sub-template RT(0) of the image of a registered fingerprint 

as result of parallel displacements of the coordinate axis of a registered fingerprint Next, following the ro- 
tation and parallel displacements of the coordinate axis of sub-template RT(0,H,V) up, down, to the left 
and to the right in the neighboring area about the center, the transformation angle S and the parallel dis- 
placement quantity (horizontal displacement quantity H, vertical displacement quantity V) of sub-template 

10 RT(S,H,V) of the registered fingerprint at the point where the degree of matching between the black pixels 

of the registered fingerprint and the black pixels of the image of the fingerprint undergoing testing is greatest 
is obtained (S.H.V are integers). 

(2) Comparison using the non sub-template (second comparison) 

The comparison of the non sub-template is the process of carrying out coordinate conversion of the 
15 black pixel address of RB(0) of the registered fingerprint according to S, H, V of RT(S,H, V) of the registered 

fingerprint which was obtained by comparison to the sub-templates and obtaining the black pixel address, 
checking the concordance of this address to the black pixel address of the image of the fingerprint to be 
tested, and outputting information related to the concordance of the registered fingerprint and the fingerprint 
undergoing testing. In other words, first, using the angle degree rotation quantity S, the horizontal displace- 
20 ment quantity M, and the vertical displacement quantity V, coordinate transformation of the black pixels of 

non sub-template RB(0) of the registered fingerprint is carried out, and RB(S,H,V) is obtained. Next, the 
concordance of the black pixels of RB(S,H,V) of the image of the registered fingerprint to the black pixels 
of the image of the fingerprint undergoing testing is checked. 

(3) A check of the number of black pixels of a discordant section is carried out 

25 (4) As the final judging process, from the results of the concordance between the sub- template and the 

non sub-template and from the check of the discordant sections, a judgement is made on the agreement 
between the complete fingerprint area of the registered fingerprint and the fingerprint undergoing testing. 
A procedure for carrying out comparison processing based in the above summary is shown in procedure 
C. The input information of procedure C is the file name of the sub-template and the non sub-template of the 
30 registered fingerprint, the image of the fingerprint undergoing testing and the approximate center point of the 
fingerprint undergoing testing. The output information of procedure C is the comparison result 

(Procedure C) 

35 Step C1 (comparison using sub- template): 

Stepd a : 

Sub-template RT(0) is stored in memory 6 from the file. Next, using sub-template RT(0), S= Smin-Smax 
40 (incremental value Ks of S), H= Hmin-Hmax (incremental value Kh of H) and V= Vmin-Vmax (incremental 
value Kv of V), the following image concordance auxiliary procedure (procedure W) is executed by using the 
registered information search incremental value, Kr=Kra (Kra^1). 

From this result, for Smin-Smax, Hmin-Hmax, and Vmin-Vmax, the values of S, H, V are changed by 
increment values Ks, Kh, Kv respectively, and Sa, Ha, and Va, which are the values of the quasi-optimal S, H, 
45 and V are obtained. 

Step C1 b ; 

Using S, H, V, where 
50 S: (Sa - Dsb) - (Sa + Dsn), incremental value Ksb 
H: (Ha - Dhb) ~~ (Ha + Dhb), incremental value Khb 
V: (Va - Dvb) - (Va + Dvb), incremental value Kvb 

procedure W is executed according to the registered information search incremental value Kr=Krc (Krc^1) of 
the black pixels of the registered information, and {Sb, Hb, Vb} which are the value of the quasi-optimal {S, H, 
55 V) are obtained. Here, Dsb, Dhb, and Dvb are predetermined numbers for setting the transposition region. 
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Step C1 c : 

Using S, H, V, where 
S: (Sb - Dsc) ~ (Sb + Dsc), incremental value Ksc 
5 H: (Hb - Dhc) - (Hb + Dhc), incremental value Khc 
V: (Vb - Dvc) ~ (Vb + Dvc), incremental value Kvc 

Step C1 d : 

10 Procedure W is executed according to S, H, V where, 
S=Sc, Dsd=0, incremental value Ksd=0 
H=Hc, Dhd=0, incremental value Khd=0 
V=Vc, Dvd=0, incremental value Kvd=0, 
and according to the registered information search incremental value Kr=Krd (Krd=1), and {Sm, Hm, Vm} which 
15 are the values of optimal {S, H, V} are obtained. Here, Dsd, Dhd and Dvd are predetermined numbers for setting 
the transposed region. From this result, each value of optimal {S, H, V} for which rate of concordance T1 of 
the sub-template becomes large and 

sub-template rate of concordance= N1m/N1c are obtained. Next for predetermined number Tk1, if 

T1£Tk1 

20 the registered fingerprint and the fingerprint undergoing testing are judged to be concordant by means of the 
comparison of the sub-templates, and step C2 is proceeded to If 

T1<Tk1 

the registered fingerprint and the fingerprint undergoing testing are judged to be discordant, and procedure C 
terminates. 

25 

Step C2 (comparison of the non sub-template) : 

Using the optimal S, H, V obtained from non sub-template RB(0) and step C1 as input information, an aux- 
iliary image concordance check procedure (procedure W) is carried out. From this result, 
30 non sub-template rate of concordance T2 = N2m/IM2c is obtained. Next, for predetermined Tk2 ( if 

T2£Tk2 

the registered fingerprint and the fingerprint undergoing testing is judged to be concordant and step C3 is pro- 
ceeded to. If 

T2<Tk2 

35 the registered fingerprint and the fingerprint undergoing testing are judged to be discordant and procedure C 
terminates. With regard to T2, instead of the non sub-template rate of concordance, it is possible to use the 
template rate of concordance (i.e., (N 1m + N 2m )/(N 1c + N^)). 

Step C3 (comparison of discordant sections): 

40 

The discordance of the black pixels of the registered fingerprint and the black pixels of the fingerprint un- 
dergoing testing is checked. In the case where the black pixels in the discordant section of the image of the 
fingerprint undergoing testing are too many, removal is necessary. For this purpose, the following procedure 
is carried out to approximately obtain and judge the ratio of the black pixels of the discordant section at the 
45 point where the line width of the image of the fingerprint undergoing testing has been matched to the image of 
the registered fingerprint. 

Step C3a : 

50 The approximate region of the area of comparison of the image of the registered fingerprint of {S.H.V} is 

obtained from the region of RT(0) and RB(0). The coordinates (X',Y') of the region transposed from coordinates 
(X,Y) is, in the same manner as procedure W, found by the following formula. 

X' = (X-X R c) • cos(S) + (Y-Y R c) ■ sin(S) + X TC -H 
Y' = -(X-X R c) • sin(S) + (Y-Y RC ) • cos(S) + Y TC - V 
55 Here, the cosine and sine functions indicate trigonometric functions. 
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Step C3b ; 

The number of black pixels Tnw of the region of comparison following coordinate conversion of the image 
of the fingerprint undergoing testing (i.e., sum aggregation of RT(S f H,V and RB(S,H,V,)) is counted. In other 
5 words, 

Tnw = total number of black pixels in the region of 
comparison following coordinate conversion of 
the fingerprint image undergoing testing 
At this time, the line width of the image of the fingerprint undergoing testing is set to w and the total number of 
10 black pixels Tnc when this line width of the image of the fingerprint undergoing testing is set to the line width 
of the image of the registered fingerprint (line width X), is given approximately by 

Tnc= Tnw/(w/>.) 

(When a partial conversion procedure (procedure D) has been carried out for the registered image of the fin- 
gerprint, 

is Tnc = (partial conversion rate) • Tnw/(w/>.)}. 

Furthermore, 

Nm= number of concordant black pixels within the region of comparison following coordinate conversion of 
the registered fingerprint information and the image of the fingerprint undergoing testing (=N1m+N2m) 
Nc= total number of black pixels within the region of comparison following coordinate conversion of the reg- 
20 istered fingerprint image (=N1 c+N2c} 

have already been obtained. 

The degree of discordance of the black pixels between two images is, for example, set to 

Tz= |Tnc-Nm|/Nc, 

where Tz is the rate of discordance. 
25 Then, if 

Tz ^ Tkc, 

the registered fingerprint and the fingerprint undergoing testing are, as the final procedure for comparison judg- 
ing, judged to be concordant, or, in the case where these conditions are not met, are judged to be discordant. 
Here, Tkc (OSTkc^l) is a predetermined number indicating the allowable ratio of the number of discordant black 
30 pixels of the fingerprint image undergoing testing, the smaller this number being, the stricter the conditions. 
(End of procedure C) 

FIG. 14 is an abbreviated flow chart of comparison processing based on procedure C. 

FIG. 15 is a conceptual diagram related to the parameters in step C3. FIG. 15 explains the relationship 
between the discordant sections and the concordant sections of the black pixel aggregation of the modified 
35 registered fingerprint image and the black pixel aggregation of the modified image of the fingerprint undergoing 
testing when the line width of the image of the fingerprint undergoing testing is made concordant to the line 
width of the modified image of the registered fingerprint. 

Remarks C(1): Each value of the incremental values (Ks,Kh,Kv), which are the incremental widths of the primary 
translation in step C1a, is checked as large values over comparatively wide limits. A narrow value is set to each 

40 value of the incremental value (Ksb,Khb,Kvb) which is the increment of secondary translation on step C1 b and 
comparatively small limits, which include the quasi-optimal values of the {S,H,V} obtained in step C1a, are 
checked. As a result of this, when the translation limits in position matching are made large, a greater reduction 
in the processing quantity can be planned for then when using a fine incremental value. 

Next, the optimal value of the incremental value of translation and the characteristics of the number of rows 

45 will be described. As the prior proposed condition, the width increment of the final row is set to 1, the number 
of rows is set through the third row and, at other than the final row, jump processing is possible for those black 
pixels for which the incremental value Kr is set to 2 or above for the search for black pixels of the registered 
information. Furthermore, the translation limits for the search of the first row is set in order to have an effect 
on the comparison accuracy. As for the quality, the larger the incremental value of the translation, the smaller 

so the number of searches becomes. The smaller the search limits, the smaller the search repetitions become. It 
is preferable that the initial line width be thick (Reason: the incremental value can be made large}. Although it 
is preferable that the incremental value in midway row N (N= 2, 3,...) be small, it may be set optionally, taking 
into consideration the incremental values of the preceding and proceeding rows. The search limits from the 
second row and on are set by the incremental width of the previous row. If the incremental values from the sec- 

55 ond row and on is not set smaller than the previous row (below 1/2), no effect is registered for the various rows. 
In order to absorb the line strain, a thick line width is preferable. Because the errors in recognition decreases 
when the final line width is fine, the incremental width of the final row is set to 1. 

In step C1 (a multi-stage process comprising 3 steps), the incremental value of each value of translation 
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can be made larger than 1 (this value is dependent upon the line width of the narrowization of the tested fin- 
gerprint image) in the primary and secondary steps, the quasi-optimal values of S, H, and V which were deter- 
mined in the prior step are set to the cardinal point in the secondary and tertiary steps, and it is permissible to 
carry out a comparison within the limits set according to the previous line width, etc. Because the number of 

5 black pixels of the registered image can be limited through a jump procedure which jumps a fixed number of 
the black pixels of the registered information depending upon the setting of the width increment Kr of the in- 
vestigation of the black pixels of the registered information, the processing quantity of the comparison (approx- 
imately proportionate to the position matching search repetition) can be reduced. The translation limits of the 
primary step (Smin-Smax, etc.) are set according to the largest permissible limits at the time of fingerprint input. 

10 The following characteristics are present. (1) The larger the translation limits the larger the number of 
search repetitions. (2) The smaller the incremental value the larger the search repetitions. (3) The increment 
value at a midway step is set taking into consideration the increment width of the immediately preceding or 
immediately proceeding step. (4) For steps other than the final step, jump search is possible. (5) When the set- 
ting of the translation limits, the incremental value and the jump search is not appropriate, errors in recognition 

15 occurs easily. 

In step C3, the line width of the modified image of the tested fingerprint is set close to the value for the line 
width of the modified image of the registered fingerprint, and the rate of discordance of the sections is obtained. 
However, it is also possible to set the line width of the modified image of the registered fingerprint close to the 
value for the line width of the modified image of the tested fingerprint, and, in this manner, obtain the rate of 
20 discordance. 

XII. Auxiliary Procedure for Checking Image Concordance 

A summary of an auxiliary procedure for conducting a check on the concordance of two images is as follows. 

25 The approximate center point (X R ,Y R ) of the registered fingerprint for each pixel address (X^Yr) of the sub- 
template RT(0) or non sub-template RB(0) of the registered fingerprint is translated in parallel so as to become 
concordant to the approximate center point (X TC ,Y TC ) of the fingerprint being tested. Next, the coordinate axis 
of the registered fingerprint is rotated and the black pixel (X R @,Y R @) address following transition is checked 
as to whether or not there are any black pixels within the fingerprint area of the image of the fingerprint under- 

30 going testing, and parallel displacement is again carried out. Where RT(S,H f V), the S, H, V and T1, N1 m and 
N1c when a high rate of concordance T1 in each value of S, H, V is present is obtained. For RB(S,H,V), S, H, 
and V are each respectively 1, and the value wherein T2 is the largest is provided. Additionally, in the first and 
second comparison of this procedure, because T1 and T2, N1m and N2m, and N1c and N2c are the same, 
they will be called T, Nm, and Nc. 

35 The input information of procedure W is the aggregation of black pixel addresses of the designated portion 

of the image of the registered fingerprint (either RT(0) or RB(0)), angle degree transposition quantity S of the 
coordinate axis (smallest value, largest value, incremental value), horizontal displacement H of the coordinate 
axis of the registered fingerprint (smallest value, largest value, incremental value), vertical displacement V of 
the coordinate axis of the registered fingerprint (smallest value, largest value, incremental value), the image 

40 of the fingerprint undergoing testing and the jump number J of the jump investigation of the black pixels of the 
registered fingerprint. 

When comparing the black pixels of the registered fingerprint with those of the fingerprint undergoing test- 
ing, the registered information incremental value {i.e., jump number J) designates the increment by which the 
black pixel of the registered fingerprint is investigated. For example, when K r =1 all of the black pixels of the 
45 registered fingerprint are investigated, and when Kr=2, every other black pixel of the registered fingerprint is 
investigated. 

The output information of procedure W is the optimal angle turning angle S about the coordinate axis for 
the registered fingerprint, the optimal coordinate axial horizontal displacement quantity H, the optimal coordin- 
ate axial horizontal displacement quantity V, the number of concordant black pixels Nm of the image of the 

so fingerprint undergoing testing and the image of the registered fingerprint for the designated region (either RT(0) 
or RB(0)), the total number of black pixels Nc of the image of the registered fingerprint of the designated region 
and the rate of concordance T. In the procedure, black pixels are checked up to a set number, and when the 
rate of concordance is below a stipulated cut-off value, for the parameter at that time, the processing is termin- 
ated midway. Furthermore, from the designation of the input information, when the similarity ratio is above a 

55 stipulated value for decision, the current {S,H,V} are judged to be at the optimal value and the following com- 
parison processing may be abbreviated. 

The processing of procedure W is shown below. FIG. 16 is an abbreviated flow chart of procedure W. 
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(Procedure W) 

Step W1 (selection of angle S): 

5 Depending on the input information of angle S, the value of S may be chosen sequentially by means of 

the incremental valve of S from the smallest S value to the largest S value (i.e., the smallest value of S is Smin, 
the largest value of S is Smax and when the value of the increment is Ks, S changes from Smin to Smax ac- 
cording to S=Smin, Smin+Ks,...Smax), and step W2 is proceeded to. 

10 Step W2, (coordinate transposition according to angle S): 

For the black pixels of the narrowization image of the inputted registered fingerprint (either RT(0) or RB(0)), 
with respect to the black pixel address which is to be investigated by the registered information search value 
(i.e., jump number) of the black pixels of the registered information 

(1) when S=0, 

X R @ = Xr-Xrc + X TC 

Yr@= Yr-Yrc + Yjc 

are set. 

(2) when S*0, 

Following parallel displacement to align the approximate center point (Xrc,Y rc ) of the registered fingerprint 
to the approximate center point of the fingerprint undergoing testing (X T c.Y TC ), coordinate axis rotation by an 
angle of S degrees is carried out with respect to all the black pixel addresses (X R( Y R ) of a black pixel aggregation 
of an image of an inputted registered fingerprint (either RT(0) or RB(0)). This is carried out according to, 
X R @= (Xr-Xrc) ■ cos(S) + (YR-YRc)-sin(S) + X TC 
Yr@ = -(Xr-Xrc) • sin(S) + (Y R -Y RC ) - cos(S) + Y TC 
According to this, an aggregation of an all black pixel address (Xr@,Y r @) of the new registered fingerprint at 
the time when H=V=0 is obtained. 

According tothe above, the approximate center (Xr C ,Yr C ) of the registered fingerprint is rotated S degrees 
about the coordinate axis of the registered fingerprint and an aggregation of an all black pixel address 
(X R @,Y R @) of the new registered fingerprint is obtained, 
(refer to Remarks for W(3)) 

Step W3 (calculation of the rate of concordance T) : 

35 Step W3a: 

The counter for the number of concordant black pixels Nrn and the counter for the total number of black 
pixels Nc in the registered fingerprint are respectively set to "0" initially. 

40 Step W3b: 

For each address of the aggregation of (Xr@,Y r @), the image of the fingerprint undergoing testing is 
checked, 

(1) If the aggregation is one of black pixels within the fingerprint area, "1" is added to the counter for the 
45 number of concordant black pixels Nm, and "1" is also added to the counter for the total number of black 

pixels Nc in the registered fingerprint. 

(2) If the aggregation is one of white pixels within the fingerprint area, or if it is outside the fingerprint area 
(treated as neither white nor black), "1" is added to the counter for the total number of black pixels Nc in 
the registered fingerprint 

so Here, whether or not midway abandonment of the comparison is possible for {S,H,V} in the comparison proc- 
essing of the sub-template is checked. In other words, for a predetermined number {Nci, Tci; i=1 ,2,...,k}, when 
counter Nc=Nci 

(Nci and k are predetermined numbers), 
Nm is set to Nmi (i=1,2,...k) as the concordance match up to that point of the parameters set according to S. 
55 H, V, and, in the case where 

Nmi/Nci<Tci, (i = 1,2,...k) 
(Tci and k are predetermined numbers. Please refer to Remarks W(1)) 
because, even should a subsequent check be conducted, there will not be a significant degree of concordance 
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obtained at the current values of S, H, and V, the current S, H, and V values at this point are discarded and 
step W4 is proceeded to in order to advance to the next S, H, and V values. 

Additionally, in the comparison processing of the sub-template when there is an indication of a midway de- 
cision (for example, construction may be accomplished so that indication is by the input information of procedure 
5 W), the next processing is carried out. When counter Nc= Ned, in the case where 

Nmi/Nci>Td = 

(Ned, Td are predetermined numbers. Please refer to Remarks W(2)) 
even if the following check is not earned out, because the rate of concordance is sufficient, step W3c is executed 
and the {S,H,V) at this time are decided as the {S,H t V} of the output information. 

10 

Step W3c: 

When step W3b has been completed for all of the addresses of the aggregations of (X R @,Y R @), 

T= Nm/Nc 

15 is calculated, and Nm, Nc and T for this {S.H.V} is memory stored. 

Step W4 (parallel displacement according to H and V): 

For the black pixel address <X@,Y@) of the new registered fingerprint when H=V=0, H and V, which have 
20 been set in the H, V storage area are selected in sequence (when H=V=0, calculation has already been com- 
pleted in step 3). When the values of H from its smallest value to its largest value and the values of V from its 
smallest value to its largest value are changed sequentially by each increment (i.e., the smallest value of H is 
Hmin, the largest is Hmax, when the increment value is Kh, the value of H changes according to H= Hmin, 
Hmin+Kh,... until the largest Kmax is reached; the smallest value of V is Vmin, the largest is Vmax, when the 
25 increment value is Kh, the value of H changes according to V=Vmin, Vmin + Kv,...) ( because (X@-H, Y@-V) 
becomes the black pixel address aggregation of the new registered fingerprint following parallel displacement, 
processing identical to step W3 is carried out for each set of {S,H,V}, and the rate of concordance is memory 
stored. 

30 Step W5 (check of unprocessed S): 

When a value of an unprocessed S is present, step W1 is proceeded to. 
When a value of an unprocessed S is not present, step W6 is proceeded to. 

35 Step W6 (judgement on the largest rate of concordance): 

For each {S,H,V}, according to each value of S and to the change in H=Hmin~-Hmax, V=Vmi-Vmax, the 
values of S, H, and V when the values of Nm, Nc are obtained when 

T= Nm/Nc 

40 is large, and are set as output information. When only one set of S, H, and V is respectively input, the current 
rate of concordance is set as output information. 
(End of procedure W) 

Remarks W(1 ): The value of Tci (i=1 ,2,...k) in step W3b is 0 ^ Tci ^ 1 . However it can t for example, be deter- 
mined as follows. When the number of all the black pixels of a modified image of a registered fingerprint is set 

45 to Nc, Nci/Nc (i=1,2,...k) indicates the condition of the progression of the processing and the limits are 0 ^ Nci/Nc 
^ 1. As Nci increases and approaches Nc, because Nmi/Nci approaches Nm/Nc, which is the rate of concor- 
dance with respect to the {S,H,V} being currently checked, Tci may be set so that Nci is as large as possible. 
The larger Tci becomes, the wider the limits for midway abandonment become. There is a considerable effect 
on the decrease in the quantity of processing required. However, this benefit is offset by the fact that, due to 

so the frequency with which errors in recognition are generated, it is necessary to set an appropriate value to Tci. 
The maximum frequency of this calculation is determined according to the set value of k (if midway abandon- 
ment of a comparison is earned out one time, the calculation for the possibility of midway abandonment for the 
values of {S,H,V} after that point is not necessary). It is necessary to set a concrete value if Tci according to 
the characteristics of the desired image. Furthermore, if the condition expression which sets the limits of the 

55 midway abandonment of the comparison also sets the midway concordance matching, the condition expression 
is not limited to the example shown is procedure W. 

Remarks W(2): The value of Ned and Td in step W3b is determined, for example, as follows. The value of Ned 
is below the Nc which is the Nc with respect to the number of all of the pixels (Nc) of the modified image of the 
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registered fingerprint, and is set to a value near Nc. Here, when N is not known beforehand, an assumed value 
may be used. The value of Td is less than 1 and is set to a value near 1. If the value of Td is made small, while 
the effect upon the reduction of processing is considerable, errors in recognition occur frequently. 

Processing according to the designation of midway decision can be utilized for reducing the time of proc- 
5 essing of the first step when, for example, carrying out the incremental value of {S,H,V} in step 2. 

Remarks W(3): The method of step W2 is as follows. For all the addresses (Xr,Y r ) in step W2, the new address 
following parallel displacement to make the approximate center point (X RC ,Y RC ) of the registered fingerprint con- 
cordant to the approximate center point (X TC ,Y TC ) of the fingerprint undergoing testing is 

Xr# = X R - (Xrc - X TC ) 

10 Yr#= Y r -(Y rc -Y tc ) 

and (Xf^Yptf) become the new address. Next coordinate axis rotation of S degrees is carried out about 

(Xtc.Ytc)- This ma y be obtained according to 

X R @ = (Xk#-XTC)coa(S) + (YR#-Y TC )sin(S) + X TC 
= (Xr-Xrc)oo8(S) + (Y R -Y RC )sin(S) + X TC 
15 Y R @ = -(XR#-X TC )sin(S) + (Yr#-Y T c)cos(S) + Y TC 

= -(X R -XRc)sin(S) + (Y R -Y RC )cos(S) + Y TC . 
Here, the values of the sine and cosine trigonometric functions may maintain the values of the limits of variation 
of the preset angle S. 

20 XIII. Flow of Registration Processing and Comparison Processing 

The flow of the registration processing and the comparison processing of a fingerprint is shown in FIG. 1 7. 
Registration processing is the process of registering the registration information of a fingerprint in memory 6 
of image processing device 1 . Comparison processing is the process of judging the concordance of a fingerprint 
25 undergoing testing to a registered fingerprint. An abbreviation of the flow from input of the fingerprint through 
registration or comparison processing is shown in the following procedure Z. 

(Procedure Z) 

30 Steps ZA 1 - ZA 5 are the in common processes of registration processing and comparison processing. 

StepZAI : 

Input of a fingerprint from image input device 2 to image memory 4. 

35 

Step ZA 2 : 

Smoothing of the gray scale image of the fingerprint in image 10 of image memory 4. 
40 Step ZA 3 : 

Binarization and background segregation of image 10 through procedure B. 
Step ZA 4 : 

45 

Obtainment of the approximate center point of the fingerprint image in image 10 through procedure Q. 
(End of steps ZA 1 - ZA 4) 

The following processing is separated by registration and comparison processing. 

Steps ZR 1 - step ZR 2 are the registration processing and the recording of the registered information of 
so the registered fingerprint in memory 6. 

Step ZR 1 : 

Narrowization processing within the fingerprint area is carried out on the binary image (primary image) of 
55 the registered image in image 10, and a modified image of the registered fingerprint (primary modified image) 
is obtained. 
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Step ZR 2 : 

The processing of registered information of the registered fingerprint is carried' out (procedure R). 
(End of steps ZR 1 - ZR 2) 

5 Steps ZC 1 - ZC 2 are for the case of comparison processing, and carry out the comparison of the finger- 

print undergoing testing to the registered fingerprint. 

StepZC 1 : 

w Narrowization is carried out with the fingerprint area of the binarized image of the tested fingerprint (sec- 
ondary image) in image 10, and a modified image of the fingerprint undergoing testing (secondary modified 
image) is obtained. 

Step ZC 2 : 

15 

Judgement is made on the concordance of the registered fingerprint to the tested fingerprint through com- 
parison processing (procedure C, procedure YT). 
(End of steps ZC 1 - ZC 2) 

The present invention is not limited to the above preferred embodiments, but may be expanded upon or 

20 altered as follows, for example, without impeding upon the effective utilization of the present invention. Fur- 
thermore, with respect to the method of image input, smoothing, binarization processing, background segre- 
gation processing, correction processing, processing to obtain the approximate center point, narrowization 
processing, and the method of calculation of the concordance and discordance in comparison processing, the 
claims of the invention of the present application are not intended to be limited by the preferred embodiments 

25 of the present invention, and variations or expansions which utilize some other method (i.e., a conventional 
method), or partial omissions are possible as well. The method of setting the X and Y coordinates is optional. 
In position matching, when the drift in the rotation is small enough to be ignored, only those errors in recognition 
for which parallel displacement is possible are checked, and the positioning of the images so that the greatest 
rate of concordance is achieved is detected. In step W2 of procedure W, when the conversion which carries 

30 out rotational and parallel displacement is performed, the expression for obtaining X R @ and Y R @ can be util- 
ized. However, it is not intended to limit the preferred embodiments of the present invention in any manner. 
For example, it is also possible to utilize 

Xr@= Xr -cos(S) + Y R sin(S) 
Y R @ = -X R - sin(S) + Y R cos(S). 

35 Furthermore, the utilization of coordinate transformation or geometric transformation is not limited. The proc- 
essing quantity necessary for comparison can be reduced due to the supplement of a value for carrying out 
rotational and parallel displacement of the sub-template as registered information (in this case, the memory 
quantity increases). 

In the preferred embodiments of the invention of the present application, the case where the image is a 
40 fingerprint is disclosed, however, provided that the image is a constituted from lines, the present invention can 
be appropriately applied. Additionally, although in the preferred embodiments of the present invention, the case 
was presented wherein a single fingerprint to be tested was compared to a single registered fingerprint, the 
present invention may also be utilized to compare a fingerprint image undergoing testing to two or more reg- 
istered fingerprints, and from the group of registered fingerprint to find the image with which the tested fingerprint 
45 has the greatest rate of concordance. The classification of the sub-template and non sub-template is not limited, 
and expansions such as classifying neither or setting man, classifications are possible. 

Effects of the Present Invention 

so In the present invention, because the width indicator value of the narrowization processing which is applied 

to primary image 1 (e.g., a registered fingerprint image) can be made less than the width indicator value of the 
narrowization processing applied to secondary image 2 (e.g., a tested fingerprint image), in the case where 
the original objects of the registered fingerprint and the tested fingerprint are the same, it is possible to make 
the line width of the primary modified image smaller than the line width of the secondary modified image at each 

55 corresponding area. Accordingly, when the individual black pixels of the primary modified image which is the 
registered information of the primary image are compared to the individual pixels of the secondary modified 
image which is the information based on the secondary image, the following effects are obtained. 1) Because 
the comparison of two images is possible without utilization of the characteristics points of an image, the com- 
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plicated image correction processing (i.e., correction using line directions) necessary for extracting the char- 
acteristic points is not necessary. 2) Because the line width of the primary image can be set to be less than 
the line width of the secondary image, in the case where the primary image and the secondary image were 
obtained from the same object, errors caused by position displacements of the images are reduced. 3) Because 

5 the number of black pixels in an image which has undergone narrowization processing are less than the total 
number of black pixels in the original image, the memory quantity necessary for registered information is less 
than that required to store as is the original image. 

By introducing the degree of the discordance between two images, it becomes possible to compare two 
images based on a comparison of the black pixels of the registered image against those of the tested image. 

10 As a result, the processing required for position matching is significantly reduced in comparison to the case 
when all black pixels of two images are checked, or the entire images, including black and white pixels, are 
checked. Because it is possible to carry out midway abandonment of a non-utilized comparison in the midway 
comparison abandonment processing, the processing quantity can be reduced. Further, due to the jump proc- 
essing of the black pixels of registered information during a comparison, the comparison processing can be 

15 decreased. In the multi-step comparison procedure, due to the setting of the quantity of position matching of 
the image information to the multi-steps, comparison can be carried out through the primary step, which trans- 
lates image information by a comparatively large translation quantity for comparatively large limits, and by the 
secondary step, which translates the image information by a comparatively small translation quantity for com- 
paratively small limits, or by the repetition of these. Accordingly, compared to the case where the image infor- 

20 mation of one image is translated by a small quantity for the entire limits, the complete processing quantity can 
be decreased. 

Due to the division and plural setting of the sub-temp late, there is no lowering of the recognition accuracy, 
and the processing quantity for position matching can be decreased more than the utilization of connective sub- 
template areas. Due to the division and establishment of one or more non sub-template and sub-template areas, 

25 the file quantity for registering the non sub-template section can be reduced. 

In the case where the thinning process of the present invention is applied to a binary image, because the 
fine lining of a binary image can be realized through the processing of the connective sections of black pixels 
and through the processing which classifies unresolved pixels as black and white pixels according to the thin- 
ning decision data for unresolved pixels, thinning processing can be carried out rapidly. Further, because the 

30 maintenance of the connectivity of the black pixels when thinning the connective sections of black pixels is car- 
ried out through reference to the original binary image, and, because it is possible to maintain the connectivity 
of the black pixels when classifying unresolved pixels as black or white pixels by the contents of the thinning 
decision data for unresolved pixels and by other processing, an advantage is offered that the maintenance of 
the connectivity of the black pixel in the thinned image can be easily maintained. 

35 From the image data memory storage process, the quantity of registered information of a fingerprint can 

be reduced. Furthermore, due to the procedure for the partial transformation of a registered image, the regis- 
tered information quantity of the fingerprint can be reduced and the comparison processing quantity can also 
be decreased. 

40 

Claims 

1 . An image processing method for judging concordance of primary and secondary images, the primary and 
secondary images consisting of black pixels and white pixels, the method comprising the steps of: 

45 (a) defining lines by aggregations of black pixels; 

(b) redefining a majority of the lines in the primary image by narrowing the lines; 

(c) redefining a majority of the lines in the secondary image by narrowing the lines so as to be not wider 
than a predetermined width, the predetermined width being equal to or narrower than the width of the 
lines prior to narrowing; 

so (d) changing the coordinates of the lines of at least one of the primary and secondary images; and 

(e) subsequently judging the concordance of the primary and secondary images by comparing the nar- 
rowed primary and secondary images. 

2. An image processing method according to claim 1 wherein a majority of the line widths of the primary image 
55 are narrowed to have a width of one pixel. 

3. An image processing method according to claim 1 wherein said predetermined width of the lines is smaller 
than the width of the widest lines in the secondary image. 
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An image processing method according to claim 1 wherein the line width of the primary image is narrowed 
to the width of one pixel, and said predetermined width of the lines is smaller than the width of the widest 
lines in the secondary image. 

An image processing apparatus forjudging the concordance of primary and secondary images, the primary 
and secondary images consisting of black pixels, forming lines, and white pixels, the image processing 
apparatus comprising: 

(a) a processing means for redefining a majority of the lines so that the lines are narrower than a pre- 
determined width, the predetermined width being equal to or narrower than the width of the lines prior 
to narrowing; 

(b) a comparing means for narrowing a majority of the lines comprising the primary image, narrowing 
a majority of the lines comprising the secondary image so as to be not wider than a predetermined width, 
the predetermined width being equal to or narrower than the width of the lines prior to narrowing, trans- 
lating the lines of at least one of the primary and secondary images, and subsequently judging the con- 
cordance of the primary and secondary images by comparing the narrowed primary and secondary 
images. 

An image processing apparatus in accordance with claim 5 wherein the lines in the primary image are nar- 
rowed to a width of one pixel, and the lines in the secondary image are narrowed to be not wider than a 
predetermined width which is equal to or narrower than the width of the lines before narrowing. 

An image processing apparatus in accordance with claim 5 wherein the predetermined width for narrowing 
the lines in the secondary image is less than the width of the widest line of the secondary image. 

An image processing apparatus in accordance with claim 5 wherein the lines in the primary image are nar- 
rowed to the width of one pixel, and the predetermined width for narrowing the lines in the secondary image 
is the width of the widest line of the secondary image. 

An image processing apparatus in accordance with claim 5 wherein the primary and secondary images 
consist of pixels having two brightness values, the image processing apparatus comprising, as a proc- 
essing means, a means for performing a first process and a second process: 

the primary process being a process for predetermining the predetermined width wx; finding the 
number of pixels in the intersections of the lines and parallel straight lines Lx; and (a) for the intersections 
having more than wx pixels in the intersection, leaving the wx black pixels of the line segment black, and 
changing all other pixels to white, and (b) for the intersections having a number of black pixels less than 
wx, maintaining the black pixels as they are; and 

the second process being a process for predetermining the predetermined width wy; finding the 
number of pixels in the intersections of the lines with the rotated imaginary parallel straight lines Ly ob- 
tainable by rotating the imaginary parallel straight lines Lx; and (a) for the intersections having more than 
wx pixels in the intersection, leaving the wx black pixels of the line segment black and changing all other 
pixels to white, and (b) for the intersections having a number of black pixels less than wx, maintaining con- 
tinuously arranged black pixels as they are. 

An image processing apparatus for judging the concordance of primary and secondary images, the primary 
and secondary images consisting of black pixels forming lines and white pixels, the image processing ap- 
paratus comprising: 

a judging means for translating one of the images and comparing the translated image with the other 
image by calculating the degree of concordance, 

wherein the judging means abandons the comparison midway in regard to the translated images 
when the degree of concordance becomes lower than a predetermined threshold value. 

An image processing apparatus forjudging the concordance between primary and secondary images, the 
primary and secondary images consisting of black pixels, forming lines, and white pixels, the image proc- 
essing apparatus comprising: 

a judging means for translating one of the images to be compared, and comparing the translated 
image to the non-translated image by calculating the degree of concordance, 

wherein the judging means judges that the secondary image being compared is concordant to the 
primary image, and abandons the comparison for the remaining translated images to be processed. 
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12. An image processing apparatus for judging the concordance of primary and secondary images, the primary 
and secondary images consisting of black pixels forming lines and white pixels, the image processing ap- 
paratus comprising: 

a judging means for translating one of the images and comparing the translated image to the non- 
5 translated other image by calculating the degree of concordance, 

wherein the translation and comparison comprise the processes of: 

translating an image by a first predetermined incremental value of translation in order to obtain a 
quasi-optimal translation position; and 

translating the image by a second predetermined incremental value of translation within the quasi- 
10 optimal translation position in order to obtain a best translated position. 

1 3. An image processing apparatus forjudging the concordance of primary and secondary images, the primary 
and secondary image consisting of black pixels, forming lines, and white pixels, the image processing ap- 
paratus comprising: 

15 (a) a processing means for redefining a majority of the lines so that the lines are narrower than a pre- 

determined width, the predetermined width being equal to or narrower than the width of the lines prior 
to narrowing: 

(b) a comparison means for narrowing a majority of the lines constituting the primary image, narrowing 
a majority of the lines constituting the secondary image so as to be not wider than a predetermined width, 
20 the predetermined width being equal to or narrower than the width of the lines prior to narrowing, trans- 

lating the lines of at least one of the primary and secondary images, and subsequently judging the con- 
cordance between the primary and secondary images by comparing the narrowed primary and 
secondary images, 

wherein the degree of discordance between the two images is approximately calculated approx- 
25 imately by comparing primary and secondary images which have been narrowed so that the lines have 

the same width. 
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14. An image processing apparatus according to claim 13 wherein the lines in the primary image are narrowed 
to have a width of one pixel. 

1 5. An image processing apparatus forjudging the concordance between primary and secondary images, the 
primary and secondary images consisting of black pixels, forming lines, and white pixels, the image proc- 
essing apparatus comprising a translation means forjudging the concordance between two images after 
translating one of the images to be compared, the image processing apparatus separating one the images 
into a sub-template area to be translated and compared to the non-translated image, and a non-subtem- 
plate area which is not to be translated or compared, either the subtemplate area or the non-subtemplate 
area being divided into multiple portions separated by areas containing unused pixels. 

16. An image processing apparatus forjudging the concordance between primary and secondary images, the 
primary and secondary images consisting of black pixels, forming lines, and white pixels, the image proc- 
essing apparatus comprising a translation means forjudging the concordance between two images after 
translating one of the images to be compared the image processing apparatus separating one the images 
into one or more sub-tempiate areas to be translated and compared to the non-translated image, and one 
or more non-subtemplate areas which is not to be translated or compared, at least one subtemplate area 
and at least one non-subtemplate area being separated by areas containing unused pixels. 

17. An image processing apparatus comprising means for determining an approximate center of an image 
wherein an area is predetermined and if the approximate center falls outside the predetermined area, the 
approximate center is reset inside the predetermined area. 

so 18. An image processing apparatus for processing images consisting of pixels having brightness values of 
two or more, the apparatus comprising: 

means for converting the image into a binary image consisting of black and white pixels in the case 
where the original image is a gray scale image; 

means for separating the binary image into two of more segments; 
55 judging means forjudging whether each segment is valid or not by calculating an average bright- 

ness of the segment, and comparing the average brightness with predetermined values. 

19. An image processing apparatus for processing images consisting of pixels having two or more brightness 
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values, the apparatus comprising: 

means for inputting images consisting of two or more brightness values; 

means for converting the image into a binary image consisting of black and white pixels, in the case 
where the original image is a gray scale image; 
5 means for separating the binary image into one or more segments; 

judging means for judging whether each segment is valid or not by calculating an average bright- 
ness of the segment and comparing the average brightness with predetermined values, and finalizing the 
image when the number of valid segments exceeds a predetermined number. 

10 20. An image processing method for recording black and white images, each image consisting of black and 
white pixels each having an address according to the X and Y axes, the method comprising the processes 
of: 

(a) selecting either the black pixels or the white pixels as the pixels to constitute a desired image; 

(b) segmenting the image into a plurality of segments each segment consisting of a representative pixel 
15 and other pixels, checking whether there is a selected black or white pixel in the segment, and when 

the check result is affirmative storing the X coordinate value of the representative pixel, whether the 
representative pixel is black or white, and whether each of the pixels in the segment is black or white. 



20 



25 



30 



50 



55 



21. An image processing apparatus for determining the optimum translation of an image by judging concor- 
dance between primary and secondary images, the images consisting of black and white pixels, the ap- 
paratus comprising: 

a first pattern translation means for consecutively translating an image at a first translation incre- 
ment, and further obtaining the black pixels in the translated image by a jump search wherein the jump 
number is equal to or larger than 2. 

22. An image processing apparatus for generating data regarding one of either the black pixels or the white 
pixels forming an image, the image consisting of black and white pixels, each constituting pixel having an 
X and Y value according to the X and Y axes, the image processing apparatus comprising: 

means for selecting one of either the black pixels or the white pixels as the object of comparison; 

and 

judging means for judging the concordance of two images after translating at least one of the im- 
ages, and changing some of the selected black or white pixels into unselected white or black pixels. 



23. An image processing method for processing an image consisting of pixels having brightness values of two 
or more, the images being stored in image memory, the method comprising: 
35 a first process of classifying pixels along parallel straight lines into narrowed black pixels, narrowed 

white pixels, and unresolved pixels; 

maintaining the connectivity regarding black pixels, and unresolved pixels according to the continu- 
ity of the original un-narrowed images; and 

a second process of changing the classification of the unresolved pixels along rotated parallel 
40 straight lines into black pixels and white pixels by using unresolved pixel judgement data that uses pixel 

aggregations, including the unresolved pixels to be processed; 

maintaining the connectivity regarding black pixels in the vicinity of the unresolved pixels and black 
pixels changed form unresolved pixels. 

45 24. An image processing method according to claim 23 wherein a narrowing method is used instead of the 
second process. 

25. An image processing method according to claim 23 wherein connectivity maintenance is at least partially 
omitted in the first process. 



26. An image processing method according to claim 23 wherein the connectivity maintenance is a least par- 
tially omitted. 

27. An image processing method according to claim 23 wherein the image stored in the image memory is a 
binary image. 
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FIG. 2(a) 
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FIG. 3(a) 
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FIG. 3(b) 
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FIG. 4(a) 

(EX.1) 

IMAGE 10 IN IMAGE MEMORY 4 
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FIG . 4(b) 



(EX.2) 

IMAGE 10 IN IMAGE MEMORY 4 




RT(0)={RT01. RT02, RT03, RT04, RT05}, RB(0)=(RT01. RB02, RB03, RB04) 
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FIG. 5 



AN EXAMPLE OF TABLE G SHOWING ACTIVATED REGIONS OF A 
FINGERPRINT (ELEMENTS ARE G(M, N)) 

•(FOR THE CASE WHERE K= 16. 'I* INDICATES ACTIVATION. *0" 
INDICATES NO ACTIVATION. THE SHAPE OF THE FINGERPRINT IS 
UNRELATED TO THE OTHER FIGURES.) 
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FIG. 6 



(a) 



IN FIG.6, P0-P24 ARE THE PIXEL P0 UNDER FOCUS AND A 5x5 
PIXEL AGGREGATION SURROUNDING P0. "B f INDICATES A BLACK 
PDCEL, WHILE "W* INDICATES A WHITE PIXEL 
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FIG. 7 
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FIG. 8 



START 



STEP A.1 



IN THE ENTIRE DIRECTION OF X IN IMAGE 10, 
FOR THOSE SELECTIONS OF CONTINUOUS BLACK PIXELS 
IN WHICH THE NUMBER OF PIXELS IS LESS THAN FIXED 
VALUE W, ONLY THE CENTER POINT IS SET TO A BLACK 
PIXEL AND ALL OTHERS ARE SET TO WHITE PIXELS. 

THOSE SECTIONS OF CONTINUOUS BLACK PIXELS 
IN WHICH THE NUMBER OF PIXELS IS GREATER THAN 
OR EQUAL TO W ARE SET AS UNRESOLVED PD(ELS. 
THOSE RESULTS ARE STORED IN IMAGE 1 1. 
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FIG. 9 



START 



STEP Tl 

PIXELS ABOUT THE CENTER ARE CLASSIFIED 
IN THE Y DIRECTION AS BLACK OR WHITE PIXELS 
FOR THE SECTIONS OF UNRESOLVED PDCELS 
IN IMAGE 1 1. THESE RESULTS ARE STORED 
IN IMAGE 11. 
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UNRESOLVED PDCELS ARE CLASSIFIED AS BLACK OF WHITE 
PIXELS WHILE MAINTAINING THEIR CONNECTIVITY WITH 
THE BLACK PDCELS NEIGHBORING THE SECTION 
OF UNRESOLVED PDCELS FOR PROCESSED IMAGE 11. 
THESE RESULTS ARE STORED IN IMAGE 1 1 . 
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FIG. 12 



AN EXAMPLE OF A THINNING DECISION DATA TABLE FOR 
UNRESOLVED PIXELS 
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EXIST IN MEMORY) 
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B=BLACK PIXEL, W=WHQTE PIXEL 
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